-- Logs begin at Thu 2022-06-16 15:40:00 UTC, end at Thu 2022-06-16 17:05:21 UTC. -- Jun 16 16:31:50.253603 dv-cinder-837355-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 16:31:50.263242 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 16:31:50 2022] *** Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: nodename: dv-cinder-837355-2-iscsi Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: machine: x86_64 Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: clock source: unix Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: pcre jit disabled Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: detected number of CPU cores: 4 Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: current working directory: / Jun 16 16:31:50.264915 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: detected binary path: /usr/bin/uwsgi-core Jun 16 16:31:50.265646 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: your processes number limit is 47680 Jun 16 16:31:50.265646 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: your memory page size is 4096 bytes Jun 16 16:31:50.265646 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: detected max file descriptor number: 2048 Jun 16 16:31:50.265646 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: lock engine: pthread robust mutexes Jun 16 16:31:50.265646 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: thunder lock: enabled Jun 16 16:31:50.265646 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 16:31:50.265646 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 16:31:50.314475 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: Python main interpreter initialized at 0x564e419bf9c0 Jun 16 16:31:50.314475 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: python threads support enabled Jun 16 16:31:50.314475 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: your server socket listen backlog is limited to 100 connections Jun 16 16:31:50.314475 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: your mercy for graceful operations on workers is 90 seconds Jun 16 16:31:50.315006 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 16:31:50.315203 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: *** Operational MODE: preforking *** Jun 16 16:31:50.315640 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: *** uWSGI is running in multiple interpreter mode *** Jun 16 16:31:50.315640 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: spawned uWSGI master process (pid: 109729) Jun 16 16:31:50.315911 dv-cinder-837355-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 16:31:50.316701 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: spawned uWSGI worker 1 (pid: 109730, cores: 1) Jun 16 16:31:50.317049 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: spawned uWSGI worker 2 (pid: 109731, cores: 1) Jun 16 16:31:50.317212 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 16:31:50.962573 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:31:50.968475 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:31:52.108025 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:31:52.108025 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: from cryptography.utils import int_from_bytes Jun 16 16:31:52.108624 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:31:52.108624 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: from cryptography.utils import int_from_bytes Jun 16 16:31:52.113640 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:31:52.113640 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: from cryptography.utils import int_from_bytes Jun 16 16:31:52.114139 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:31:52.114139 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: from cryptography.utils import int_from_bytes Jun 16 16:31:54.603423 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:31:54.604177 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:31:54.604177 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:31:54.604568 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:31:54.604820 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:31:54.605196 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.605376 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:31:54.605762 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.605858 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:31:54.605930 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.606074 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.606162 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:31:54.606418 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.606566 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:31:54.606676 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.606769 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:31:54.607015 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.607198 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.607312 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.607410 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.607657 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.607804 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.607898 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.608015 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.608202 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.608370 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.608503 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837355-2-iscsi {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.608679 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.608812 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.608991 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.609139 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.609288 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.609380 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.609609 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.609700 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.609860 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.609959 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.610171 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.610269 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.610492 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837355-2-iscsi {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.610595 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.610799 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.610948 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.611147 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.612183 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.612334 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.612456 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.612592 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.612717 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.612841 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.612964 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.613086 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.613221 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.613352 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.613469 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.613593 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.613738 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.613876 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614017 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614142 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614255 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614376 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614499 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614620 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614744 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837355-2-iscsi {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.614876 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615001 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615158 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615290 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615419 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615542 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615671 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615795 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.615926 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.616058 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.616188 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.616312 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.616585 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837355-2-iscsi {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.616722 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.616866 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.617002 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.617167 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.617295 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.617482 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.617610 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.617789 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.617917 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.618089 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.618221 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.618408 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.618537 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.618691 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.618829 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.618998 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.619140 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.619372 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.619631 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.620034 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.620159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.620296 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.620429 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.620552 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.620552 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.620829 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621027 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621153 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621290 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621414 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621537 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621668 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621798 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.621934 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622058 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622195 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622328 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622467 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622591 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622714 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622836 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.622967 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.623120 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.623253 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.623379 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.623513 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.623640 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.623770 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.623902 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624029 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624155 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624278 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624403 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624532 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624670 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624793 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.624949 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.625079 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.625267 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.625409 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.625567 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.625696 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.625889 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.626018 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.626198 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.626336 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.626463 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.626612 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.626787 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.626917 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.627103 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.627251 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.627387 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.627511 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.627711 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.627839 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.628022 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.628156 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.628311 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.628448 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.628612 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.628740 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.628930 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.629070 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.629226 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.629363 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.629498 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.629621 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.630132 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.630265 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.630440 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.630576 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.630762 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.630891 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.631045 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.631194 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.631326 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.631458 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.631587 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.631723 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.631899 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.632027 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.632214 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.632354 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.632485 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.632620 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.632833 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.632976 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.633101 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.633223 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.633411 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.633621 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.633747 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.633870 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.633992 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.634120 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.634250 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.634382 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.634562 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.634699 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.634931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.635464 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.635594 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.635733 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.635858 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.635982 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636106 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636237 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636370 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636494 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636616 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636739 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636861 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.636984 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.637120 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.637245 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.637368 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.637491 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.637612 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.637744 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.637881 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638006 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638128 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638250 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638380 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638503 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638635 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638758 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.638938 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.639135 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.639275 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.639414 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.639553 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.639678 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.639801 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.639923 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.640116 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.640247 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.640378 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.640508 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.640706 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.640842 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.640966 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.641088 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.641280 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.641416 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.641579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.641708 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.641883 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.642006 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.642150 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.642277 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.642462 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.642591 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.642745 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.642883 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.643029 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.643175 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.643363 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.643492 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.643647 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.643789 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.643913 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.644036 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.644228 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.644359 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.644538 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.644682 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.644837 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.644966 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.645153 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.645283 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.645407 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.645537 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.645723 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.645861 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.645985 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.646107 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.646302 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.646447 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.646571 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.646694 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.646891 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.647020 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.647219 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.647345 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.647527 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.647656 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.647830 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.647966 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.648104 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.648229 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.648428 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:31:54.648559 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.648759 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.648889 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.649085 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.649281 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.649406 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.649537 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.649661 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.649793 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.649956 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.650095 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.650277 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.650441 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.650696 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.651142 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.651263 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.651375 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.651499 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.651622 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.651746 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.651877 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652002 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652137 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652270 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652394 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652517 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652649 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652783 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.652913 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.653061 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.653186 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.653350 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.653560 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.653686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.653811 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.653999 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.654138 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.654305 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.654442 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.654598 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.654727 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.654919 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.655101 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.655254 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.655380 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.655503 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.655625 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.655823 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.655954 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.656136 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.656268 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.656454 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.656596 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.656721 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.656843 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.657050 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.657180 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.657358 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.657488 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.657651 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.657781 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.657949 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.658088 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.658261 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.658390 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.658564 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.658712 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.658889 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.659027 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.659208 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.659336 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.659521 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.659662 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.659818 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.659957 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.660112 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.660237 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.660420 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.660557 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.660713 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.660843 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.661023 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.661154 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.661287 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.661420 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.661600 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.661730 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.661893 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.662023 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.662192 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.662321 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.662499 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.662629 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.662807 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.662935 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.663117 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.663244 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.663430 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.663571 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.663726 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.663865 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.664029 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.664150 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.664331 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.664467 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.664622 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.664750 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.664924 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.665053 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.665215 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.665344 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.665529 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.665658 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.665796 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.665920 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.666133 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.666391 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.666837 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.666974 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.666974 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.667252 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.667378 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.667508 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.667636 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.667769 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.667901 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668035 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668281 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668413 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668546 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668678 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668802 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.668925 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669055 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669178 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669309 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669440 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669572 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669706 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669831 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.669987 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.670116 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.670294 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.670422 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.670603 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.670730 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.670908 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.671044 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.671242 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.671401 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.671550 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.671678 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.671855 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.671996 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.672170 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.672296 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.672469 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.672612 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.672770 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.672897 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.673067 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.673203 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.673363 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.673504 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.673660 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.673787 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.673962 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.674089 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.674257 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.674421 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.674546 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.674676 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.674836 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.674970 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.675157 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.675298 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.675456 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.675583 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.675762 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.675931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.676068 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.676198 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.676335 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.676459 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.676621 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.676754 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.676916 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.677062 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.677219 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.677350 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.677496 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.677623 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.677798 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.677927 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.678115 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.678250 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.678419 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.678546 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.678720 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.678847 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.679022 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.679197 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.679333 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.679469 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.679649 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.679775 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.679953 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.680080 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.680259 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.680394 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.680561 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.680697 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.680863 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.680990 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.681163 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.681374 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.681500 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.681623 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.681826 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.682423 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.682557 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.682698 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.682824 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.682947 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683097 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683224 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683347 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683484 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683609 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683853 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.683976 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.684108 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.684234 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.684355 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.684479 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.684610 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.684746 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.684883 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.685007 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.685129 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.685311 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.685446 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.685616 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.685752 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.685920 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.686079 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.686227 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.686354 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.686532 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.686669 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.686845 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.686991 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.687168 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.687294 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.687479 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.687606 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.687781 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.687908 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.688095 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.688221 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.688397 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.688532 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.688706 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.688871 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.689000 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.689123 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.689293 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.689422 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.689610 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.689734 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.689916 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.690044 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.690218 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.690343 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.690523 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.690648 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.690833 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.690957 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.691156 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.691294 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.691459 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.691585 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.691769 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.691905 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.692068 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.692193 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.692366 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.692493 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.692667 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.692807 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.692977 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.693103 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.693278 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.693404 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.693579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.693715 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.693877 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.694003 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.694176 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.694300 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.694473 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.694606 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.694768 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.694894 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.695097 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.695227 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.695386 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.695512 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.695691 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.695819 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.695992 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.696119 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.696300 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.696428 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.696605 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.696732 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.696899 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.697022 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.697196 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.697428 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.697730 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.698161 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.698161 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.698400 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.698539 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.698664 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.698787 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.698911 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699042 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699207 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699333 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699457 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699703 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699825 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.699963 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700094 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700217 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700341 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700471 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700595 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700727 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700850 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.700974 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.701097 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.701220 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.701371 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.701511 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.701690 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.701816 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.701997 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.702124 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.702298 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.702433 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.702601 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.702727 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.702904 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.703031 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.703216 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.703351 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.703519 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.703654 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.703831 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.703956 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.704130 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.704270 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.704428 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.704546 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.704728 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.704854 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.705023 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.705152 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.705323 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.705449 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.705626 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.705759 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.705943 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.706189 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.706317 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.706515 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.706642 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.706827 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.706954 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.707147 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.707275 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.707456 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.707577 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.707764 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.707890 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.708086 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.708323 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.708452 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.708651 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.708786 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.708983 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.709117 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.709249 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.709375 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.709560 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.709687 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.709872 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.709998 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.710173 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.710299 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.710469 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.710595 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.710765 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.710892 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.711096 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.711240 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.711389 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.711517 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.711691 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.711827 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.711987 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.712115 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.712282 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.712408 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.712578 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.712718 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.712873 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.713093 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.713623 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.713767 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.713931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714058 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714181 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714305 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714428 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714560 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714697 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714822 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.714945 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715094 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715221 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715344 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715484 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715610 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715733 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715857 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.715980 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.716135 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.716263 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.716461 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.716588 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.716767 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.716895 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.717067 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.717195 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.717363 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.717488 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.717662 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.717789 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.717947 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.718071 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.718239 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.718365 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.718533 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.718660 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.718834 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.718961 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.719156 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.719284 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.719452 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.719592 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.719753 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.719880 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.720053 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.720180 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.720352 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.720487 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.720651 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.720778 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.720944 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.721072 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.721241 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.721385 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.721537 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.721663 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.721846 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.721974 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.722147 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.722289 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.722441 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.722567 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.722735 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.722854 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.723035 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.723196 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.723353 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.723481 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.723646 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.723779 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.723942 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.724077 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.724232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.724366 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.724536 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.724664 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.724831 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.724958 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.725131 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.725260 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.725415 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.725541 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.725714 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.725840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.726008 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.726143 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.726299 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.726433 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.726596 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.726731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.726896 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.727021 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.727217 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.727357 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.727512 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.727639 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.727810 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.727935 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.728102 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.728243 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.728398 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.728524 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.728796 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.729302 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.729302 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.729564 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.729564 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.729798 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.729920 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730052 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730186 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730311 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730434 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730557 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730680 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730810 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.730943 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.731117 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.731258 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.731385 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.731508 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.731632 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.731822 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.731960 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.732118 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.732244 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.732417 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.732543 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.732752 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.732876 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.732999 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.733132 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.733280 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.733421 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.733579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.733704 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.733875 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.734001 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.734168 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.734302 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.734462 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.734589 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.734762 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.734897 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.735076 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.735219 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.735398 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.735533 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.735703 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.735831 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.736003 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.736138 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.736301 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.736437 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.736599 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.736726 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.736900 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.737026 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.737195 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.737330 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.737501 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.737637 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.737805 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.737939 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.738107 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.738234 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.738402 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.738537 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.738698 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.738825 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.739010 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.739159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.739337 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.739477 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.739643 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.739771 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.739949 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.740083 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.740259 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.740393 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.740563 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.740689 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.740854 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.740979 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.741151 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.741289 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.741432 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.741565 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.741741 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.741870 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.742045 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.742199 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.742346 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.742482 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.742651 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.742777 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.742954 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.743113 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.743276 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.743412 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.743579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.743712 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.743883 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.744018 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.744198 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.744400 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.744590 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.744806 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.745038 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.745171 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.745355 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.745483 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.745669 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.745809 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.745966 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.746099 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.746265 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.746392 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.746560 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.746688 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.746863 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.746991 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.747169 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.747305 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.747480 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.747606 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.747786 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.747914 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.748087 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.748214 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.748408 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.748547 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.748713 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.748849 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.749014 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.749140 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.749314 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.749449 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.749613 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.749740 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.749906 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.750032 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.750209 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.750348 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.750636 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.750765 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.750889 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.751012 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.751228 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.751370 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.751526 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.751652 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.751826 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.751960 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.752126 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.752253 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.752439 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.752565 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.752757 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.752893 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.753027 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.753142 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.753303 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.753429 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.753612 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.753746 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.753906 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.754047 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.754215 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.754341 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.754592 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.754717 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.755215 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.755343 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.755521 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.755648 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.755840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.755975 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.756141 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.756268 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.756440 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.756568 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.756740 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.756875 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.757056 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.757183 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.757355 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.757481 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.757660 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.757793 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.757959 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.758078 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.758258 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.758384 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.758569 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.758706 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.758882 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.759032 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.759210 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.759363 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.759504 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.759631 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.759894 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.760175 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.760688 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.760688 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.760936 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.761067 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.761204 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.761471 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.761791 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.761925 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.762092 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.762229 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.762404 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.762525 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.762720 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.762849 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.763020 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.763210 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.763349 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.763476 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.763613 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.763738 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.763910 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.764036 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.764206 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.764333 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.764518 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.764646 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.764812 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.764949 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.765114 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.765242 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.765417 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.765552 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.765716 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.765895 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.766023 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.766221 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.766348 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.766531 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.766658 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.766849 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.766985 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.767194 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.767336 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.767501 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.767627 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.767801 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.767928 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.768107 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.768234 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.768403 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.768541 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.768702 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.768828 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.769000 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.769135 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.769295 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.769431 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.769589 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.769715 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.769887 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.770021 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.770190 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.770325 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.770494 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.770630 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.770796 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.770923 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.771138 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.771283 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.771445 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.771570 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.771752 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.771879 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.772047 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.772181 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.772369 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.772497 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.772676 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.772802 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.772976 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.773103 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.773289 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.773414 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.773587 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.773713 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.773883 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.774011 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.774179 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.774307 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.774473 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.774598 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.774768 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.774896 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.775077 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.775207 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.775389 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.775635 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.775850 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.776276 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.776276 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.776529 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.776655 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.776793 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.776919 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777044 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777167 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777291 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777422 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777565 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777690 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777820 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.777994 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.778122 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.778297 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.778431 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.778593 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.778721 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.778896 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.779021 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.779254 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.779383 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.779506 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.779633 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.779796 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.779924 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.780103 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.780231 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.780404 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.780539 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.780703 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.780831 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.781002 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.781130 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.781320 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.781455 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.781620 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.781759 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.781932 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.782065 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.782234 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.782369 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.782565 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.782701 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.782872 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.783008 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.783195 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.783323 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.783522 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.783661 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.783821 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.783947 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.784125 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.784251 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.784433 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.784569 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.784756 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.784946 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.785073 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.785269 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.785405 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.785579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.785715 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.785883 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.786010 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.786190 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.786391 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.786517 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.786648 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.786773 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.786904 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.787090 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.787238 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.787399 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.787528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.787704 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.787839 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.788005 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.788142 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.788323 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.788450 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.788637 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.788765 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.788954 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.789084 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.789279 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.789471 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.789597 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.789800 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.789936 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.790114 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.790248 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.790423 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.790558 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.790731 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.790868 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.791152 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.791412 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.791567 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.791703 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.792007 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.792324 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.792514 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.792673 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.792839 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.793020 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.793186 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.793337 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.793509 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.793681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.793828 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.793975 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.794130 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.794277 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.794421 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.794575 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.794718 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.794871 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.795021 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.795210 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.795368 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.795531 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.795697 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.795878 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.796041 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.796203 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.796374 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.796542 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.796720 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.796866 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.797024 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.797169 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.797313 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.797463 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.797615 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.797758 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.797902 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.798044 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.798194 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.798381 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.798574 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.798720 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.798863 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.799016 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.799229 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.799387 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.799531 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.799673 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.799815 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.799956 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.800099 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.800249 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.800392 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.800545 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.800687 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.800833 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.800985 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.801137 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.801280 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.801462 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.801604 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.801775 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.801926 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.802078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.802219 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.802392 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.802545 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.802689 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.802851 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.803011 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.803203 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.803345 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.803497 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.803655 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.803825 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.803974 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.804145 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.804298 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.804494 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.804638 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.804812 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.804963 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.805114 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.805263 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.805405 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.805558 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.805709 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.805853 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.805995 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.806136 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.806278 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.806440 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.806607 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.806811 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.807045 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.807201 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.807400 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.807536 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.807716 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.807837 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.808026 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.808148 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.808335 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.808465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.808685 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.808824 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.808954 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.809080 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.809252 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.809371 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.809564 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.809693 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.809868 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.809991 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.810195 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.810316 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.810502 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.810623 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.810810 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.810929 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.811133 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.811255 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.811448 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.811569 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.811751 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.811869 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.812052 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.812173 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.812355 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.812475 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.812656 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.812787 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.812962 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.813082 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.813268 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.813390 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.813568 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.813698 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.813865 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.814008 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.814151 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.814292 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.814436 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.814586 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.814735 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.814878 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.815028 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.815210 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.815354 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.815581 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.815725 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.815867 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.816016 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.816167 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.816312 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.816463 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.816606 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.816773 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.816949 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.817115 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.817267 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.817411 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.817552 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.817702 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.817847 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.817989 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.818141 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.818291 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.818434 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.818635 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.818827 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.818974 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.819154 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.819300 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.819449 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.819593 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.819735 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.819886 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.820038 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.820187 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.820331 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.820503 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.820648 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.820810 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.820952 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.821121 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.821330 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.821476 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.821662 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.821816 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.821979 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.822133 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.822327 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.822521 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.822749 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.822910 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.823109 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.823348 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.823503 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.823660 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.823818 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.823963 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.824107 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.824249 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.824391 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.824542 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.824696 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.824839 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.824987 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.825159 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.825314 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.825460 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.825612 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.825757 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.825899 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.826043 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.826186 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.826338 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.826482 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.826623 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.826774 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.826937 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.827154 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.827327 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.827478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.827622 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.827773 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.827917 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.828061 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.828212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.828364 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.828507 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.828659 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.828827 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.828998 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.829166 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.829313 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.829468 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.829628 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.829774 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.829933 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.830082 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.830227 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.830378 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.830524 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.830678 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.830833 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.830981 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.831178 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.831320 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.831473 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.831616 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.831776 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.831919 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.832063 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.832204 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.832345 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.832502 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.832645 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.832787 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.832927 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.833078 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.833219 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.833401 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.833555 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.833704 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.833855 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.833997 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.834141 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.834297 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.834445 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.834587 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.834737 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.834878 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.835030 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.835206 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.835351 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.835494 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.835637 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.835780 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.835938 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.836082 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.836232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.836383 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.836527 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.836672 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.836823 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.836977 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.837145 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.837308 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.837468 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.837627 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.837770 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.837911 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.838112 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.838281 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.838427 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.838586 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.838730 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.838730 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.839031 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.839244 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.839399 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.839551 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.839692 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.839692 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.839962 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.840103 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.840251 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.840403 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.840552 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.840693 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.840842 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.840992 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.841144 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.841294 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.841446 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.841587 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.841742 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.841882 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.842042 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.842185 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.842326 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.842466 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.842607 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.842747 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.842898 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.843039 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.843219 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.843366 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.843540 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.843708 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.843927 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.844080 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.844233 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.844379 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.844524 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.844679 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.844825 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.844970 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.845115 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.845267 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.845415 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.845570 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.845717 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.845863 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.846014 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.846161 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.846307 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.846461 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.846607 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.846752 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.846896 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.847041 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.847244 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.847418 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.847575 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.847718 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.847879 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.848021 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.848172 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.848314 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.848455 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.848596 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.848744 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.848894 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.849052 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.849213 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.849362 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.849523 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.849708 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.849885 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.850038 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.850179 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.850330 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.850479 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.850620 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.850769 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.850912 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.851091 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.851245 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.851399 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.851545 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.851703 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.851847 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.851991 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.852144 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.852287 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.852430 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.852581 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.852725 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.852871 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.853015 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.853159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.853316 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.853459 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.853665 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.853833 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.853833 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.854234 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.854394 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.854549 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.854703 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.854849 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.854995 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.855187 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.855343 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.855485 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.855631 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.855773 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.855923 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.856071 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.856222 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.856364 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:31:54.856505 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.856505 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.856505 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.856915 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.857113 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.857424 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.857735 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.858037 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:31:54.858277 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109730) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:31:54.917405 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO dbcounter [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Registered counter for database nova_api Jun 16 16:31:54.920211 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO dbcounter [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Registered counter for database nova_api Jun 16 16:31:54.938836 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_db.sqlalchemy.engines [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:54.941070 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:54.945392 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writer thread running {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:54.948383 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writer thread running {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:55.001665 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.context [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2503fb0-10e9-49f5-9aa8-746908a7d718(cell1) {{(pid=109731) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:31:55.004410 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.context [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2503fb0-10e9-49f5-9aa8-746908a7d718(cell1) {{(pid=109730) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:31:55.006116 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:55.007711 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:55.008493 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:55.008784 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_concurrency.lockutils [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:55.010474 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_concurrency.lockutils [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:55.010662 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:55.011234 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_concurrency.lockutils [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:31:55.012689 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO dbcounter [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Registered counter for database nova_cell0 Jun 16 16:31:55.013171 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_concurrency.lockutils [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109730) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:31:55.015279 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO dbcounter [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Registered counter for database nova_cell0 Jun 16 16:31:55.016564 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO dbcounter [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Registered counter for database nova_cell1 Jun 16 16:31:55.019210 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO dbcounter [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Registered counter for database nova_cell1 Jun 16 16:31:55.024875 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_db.sqlalchemy.engines [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:55.027762 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_db.sqlalchemy.engines [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:55.028531 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:55.031617 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:55.036124 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writer thread running {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:55.036259 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writer thread running {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:55.036455 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writer thread running {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:55.038750 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writer thread running {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:55.179544 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO dbcounter [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Registered counter for database nova_cell0 Jun 16 16:31:55.181545 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO dbcounter [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Registered counter for database nova_cell0 Jun 16 16:31:55.187461 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_db.sqlalchemy.engines [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:55.189317 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG oslo_db.sqlalchemy.engines [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109730) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:31:55.192733 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writer thread running {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:55.193793 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writer thread running {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:31:55.524114 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: WARNING keystonemiddleware.auth_token [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:31:55.527739 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: WARNING keystonemiddleware.auth_token [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:31:55.531460 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: WARNING keystonemiddleware.auth_token [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:31:55.534923 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: WARNING keystonemiddleware.auth_token [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:31:55.868782 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: WARNING keystonemiddleware.auth_token [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:31:55.874828 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: WARNING keystonemiddleware.auth_token [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:31:55.875857 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: WARNING keystonemiddleware.auth_token [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:31:55.880261 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e419bf9c0 pid: 109731 (default app) Jun 16 16:31:55.882123 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: WARNING keystonemiddleware.auth_token [None req-e0b3a760-1714-4427-96dc-10093a53d143 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:31:55.882260 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:31:55.883508 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] 10.222.0.74 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001715 Jun 16 16:31:55.883903 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 1/1] 10.222.0.74 () {50 vars in 788 bytes} [Thu Jun 16 16:31:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:31:55.887539 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564e419bf9c0 pid: 109730 (default app) Jun 16 16:33:13.040142 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:13.041133 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 16 16:33:13.041505 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 2/2] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:13.057778 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writing DB stats nova_api:SELECT=3 {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:13.058962 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writing DB stats nova_cell0:SELECT=3 {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:13.059782 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writing DB stats nova_cell1:SELECT=3 {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:13.060814 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:13.507117 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-10ffd2a5-b3be-4716-9396-80f07d4d3a9e admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:13.539485 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-10ffd2a5-b3be-4716-9396-80f07d4d3a9e admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490741 Jun 16 16:33:13.540407 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 1/3] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Jun 16 16:33:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:15.712861 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:15.713790 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-21b1e10a-3540-4ada-a520-ea1a1a79d49e None None] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jun 16 16:33:15.714186 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 3/4] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:15.777869 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-7cd3675a-4c3a-4081-bead-639cf0c91a98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "ram": 256, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:15.795448 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:33:15.795448 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: warnings.warn(msg) Jun 16 16:33:15.826453 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-7cd3675a-4c3a-4081-bead-639cf0c91a98 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.105277 Jun 16 16:33:15.827007 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 2/5] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:15.841116 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_api:SELECT=3 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:15.842018 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_cell1:SELECT=3 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:15.843080 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_cell0:SELECT=3 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:15.843878 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:33:16.050243 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-464417f1-1007-4f75-b1a4-8b18c9215446 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:16.052642 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:33:16.052642 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: warnings.warn(msg) Jun 16 16:33:16.117554 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-464417f1-1007-4f75-b1a4-8b18c9215446 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282115 Jun 16 16:33:16.118139 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 4/6] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Jun 16 16:33:15 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:33:18.333357 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-7cd3675a-4c3a-4081-bead-639cf0c91a98 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:18.334483 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-7cd3675a-4c3a-4081-bead-639cf0c91a98 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Jun 16 16:33:18.334880 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 3/7] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:18.443260 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-c2be132e-7141-4c76-a8a5-be68c6b3e22c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "swap": 0, "os-flavor-access:is_public": true, "id": "d1", "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:18.460989 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:33:18.460989 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: warnings.warn(msg) Jun 16 16:33:18.481280 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-c2be132e-7141-4c76-a8a5-be68c6b3e22c admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140281 Jun 16 16:33:18.482137 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 5/8] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:18.494323 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-52ed7937-ab6c-4029-94c7-d26891c0b11d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:18.496102 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:33:18.496102 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: warnings.warn(msg) Jun 16 16:33:18.529786 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-52ed7937-ab6c-4029-94c7-d26891c0b11d admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039413 Jun 16 16:33:18.530697 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 4/9] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Jun 16 16:33:18 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:20.692767 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-c2be132e-7141-4c76-a8a5-be68c6b3e22c admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:20.693770 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-c2be132e-7141-4c76-a8a5-be68c6b3e22c admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jun 16 16:33:20.694136 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 6/10] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:20.755086 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-64b8cf12-b0e7-48fa-ae56-d6701bc3f022 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:20.775103 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-64b8cf12-b0e7-48fa-ae56-d6701bc3f022 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074789 Jun 16 16:33:20.775975 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 5/11] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:20.788224 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-e89ac3c6-6aaf-4d66-b8d5-4cf5586270a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:20.812009 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-e89ac3c6-6aaf-4d66-b8d5-4cf5586270a3 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027452 Jun 16 16:33:20.812599 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 7/12] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Jun 16 16:33:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:23.002591 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-64b8cf12-b0e7-48fa-ae56-d6701bc3f022 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:23.003647 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-64b8cf12-b0e7-48fa-ae56-d6701bc3f022 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 16 16:33:23.004044 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 6/13] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:23.064554 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-44de02b0-ce66-4741-8ee3-44a5d1967932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "rxtx_factor": 1.0, "disk": 10}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:23.082958 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-44de02b0-ce66-4741-8ee3-44a5d1967932 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072779 Jun 16 16:33:23.083695 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 8/14] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:23.095715 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-a444b47d-e0c6-4348-b09a-e69b3d8c008d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:23.118960 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-a444b47d-e0c6-4348-b09a-e69b3d8c008d admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026924 Jun 16 16:33:23.119584 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 7/15] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Jun 16 16:33:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:25.278759 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-44de02b0-ce66-4741-8ee3-44a5d1967932 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:25.279807 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-44de02b0-ce66-4741-8ee3-44a5d1967932 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 16 16:33:25.280173 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 9/16] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:25.369712 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-d46a5e20-2928-4d0e-86c0-57e2b709b010 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "rxtx_factor": 1.0}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:25.391579 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-d46a5e20-2928-4d0e-86c0-57e2b709b010 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.105226 Jun 16 16:33:25.392495 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 8/17] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:25.407104 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-d2b69b0a-0f8b-472e-89c8-cc4955e4b4ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:25.440639 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-d2b69b0a-0f8b-472e-89c8-cc4955e4b4ab admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037187 Jun 16 16:33:25.442321 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 10/18] 10.222.0.74 () {64 vars in 1335 bytes} [Thu Jun 16 16:33:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:27.612786 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-d46a5e20-2928-4d0e-86c0-57e2b709b010 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:27.613779 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-d46a5e20-2928-4d0e-86c0-57e2b709b010 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 16 16:33:27.614338 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 9/19] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:27.675985 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-67997e0a-a35c-41a2-a1e0-a03d39930a65 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:27.700823 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-67997e0a-a35c-41a2-a1e0-a03d39930a65 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079565 Jun 16 16:33:27.703626 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 11/20] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Jun 16 16:33:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:33:29.851526 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-d46a5e20-2928-4d0e-86c0-57e2b709b010 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:29.852779 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-d46a5e20-2928-4d0e-86c0-57e2b709b010 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002008 Jun 16 16:33:29.853363 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 10/21] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:29.914411 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-4fa40877-4ea5-4628-9f43-fc8d12d8ebb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:29.933372 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-4fa40877-4ea5-4628-9f43-fc8d12d8ebb2 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072636 Jun 16 16:33:29.934113 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 12/22] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:29 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:33:29.947863 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-127c8e0c-6ac4-4441-b3f8-be9c197981fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:29.971258 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-127c8e0c-6ac4-4441-b3f8-be9c197981fc admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027218 Jun 16 16:33:29.971860 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 11/23] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Jun 16 16:33:29 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:33:32.190873 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-4fa40877-4ea5-4628-9f43-fc8d12d8ebb2 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:32.191996 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-4fa40877-4ea5-4628-9f43-fc8d12d8ebb2 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 16 16:33:32.192411 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 13/24] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:33:32.255010 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-b7b17899-fa0c-402d-be8c-6aa44d760ff8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 20, "name": "m1.small", "rxtx_factor": 1.0, "swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:32.275179 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-b7b17899-fa0c-402d-be8c-6aa44d760ff8 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075343 Jun 16 16:33:32.275738 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 12/25] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:32.288304 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-638dfd15-3abc-435c-81f8-20a090277fab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:32.311382 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-638dfd15-3abc-435c-81f8-20a090277fab admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026714 Jun 16 16:33:32.311961 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 14/26] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Jun 16 16:33:32 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:34.685289 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-b7b17899-fa0c-402d-be8c-6aa44d760ff8 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:34.686403 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-b7b17899-fa0c-402d-be8c-6aa44d760ff8 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Jun 16 16:33:34.686861 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 13/27] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:34.747101 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-1d4ab515-4806-42b0-935a-2dcf3452709d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "ram": 4096}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:34.766496 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-1d4ab515-4806-42b0-935a-2dcf3452709d admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073584 Jun 16 16:33:34.767065 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 15/28] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:33:34.778984 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c1f5cc9f-aa9a-4b3b-86a6-9a922be125c5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:34.802208 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c1f5cc9f-aa9a-4b3b-86a6-9a922be125c5 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026862 Jun 16 16:33:34.802696 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 14/29] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Jun 16 16:33:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:36.962439 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-1d4ab515-4806-42b0-935a-2dcf3452709d admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:36.963650 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-1d4ab515-4806-42b0-935a-2dcf3452709d admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 16 16:33:36.963885 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 16/30] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:37.026627 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-8a40d921-9b84-471e-8cf3-711cee44287b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "rxtx_factor": 1.0}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:37.045304 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-8a40d921-9b84-471e-8cf3-711cee44287b admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075590 Jun 16 16:33:37.046015 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 15/31] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:37.058579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-93d0783a-a568-4c0f-ac31-ff393b356458 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:37.082325 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-93d0783a-a568-4c0f-ac31-ff393b356458 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028246 Jun 16 16:33:37.082928 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 17/32] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Jun 16 16:33:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:33:39.312695 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-8a40d921-9b84-471e-8cf3-711cee44287b admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:33:39.314451 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-8a40d921-9b84-471e-8cf3-711cee44287b admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Jun 16 16:33:39.314853 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 16/33] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:33:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:33:39.391312 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-55c931ee-3808-4e20-b7d4-1a50b5c88be9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "id": "5", "disk": 160, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:39.415741 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-55c931ee-3808-4e20-b7d4-1a50b5c88be9 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.093091 Jun 16 16:33:39.416440 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 18/34] 10.222.0.74 () {64 vars in 1282 bytes} [Thu Jun 16 16:33:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:33:39.430173 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-ff46979f-f0ee-402a-b0e7-deb5e3a31791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:33:39.456509 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-ff46979f-f0ee-402a-b0e7-deb5e3a31791 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031565 Jun 16 16:33:39.457910 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 17/35] 10.222.0.74 () {64 vars in 1332 bytes} [Thu Jun 16 16:33:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:34:04.761621 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-55c931ee-3808-4e20-b7d4-1a50b5c88be9 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:04.762622 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-55c931ee-3808-4e20-b7d4-1a50b5c88be9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 16 16:34:04.763000 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 19/36] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:04.773856 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:04.825646 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-bc3f0ef7-dc4a-49b7-90c1-724a6903fd1d admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:04.842620 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-bc3f0ef7-dc4a-49b7-90c1-724a6903fd1d admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073528 Jun 16 16:34:04.843174 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 18/37] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Jun 16 16:34:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:34:05.827898 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-55c931ee-3808-4e20-b7d4-1a50b5c88be9 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:05.828911 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-55c931ee-3808-4e20-b7d4-1a50b5c88be9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 16 16:34:05.829303 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 20/38] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:06.035501 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-d03c2395-385f-4e0a-bd5a-feb194dae5c5 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:06.043076 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.wsgi [None req-d03c2395-385f-4e0a-bd5a-feb194dae5c5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-d03c2395-385f-4e0a-bd5a-feb194dae5c5 admin admin] Request method failure captured: Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Accept: application/json Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Accept-Encoding: gzip, deflate Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Connection: keep-alive Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Content-Length: 0 Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Host: 10.222.0.74 Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Openstack-Api-Version: compute 2.90 Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Openstack-System-Scope: None Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: User-Agent: python-novaclient Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Auth-Token: gAAAAABiq1t9RN1XL4halEr4DfFuQQMRPtplYIDf6r3YxrutGoXIdMZgAxgSa5KswB5y0hqppCcBuKHyNJIGKrLGtKTH4VaPJ70lmbXC9X-0fJYfghPaDeoF4lVe9Ph7Q4ZlG1c-FWcgpgeUg32lK__bZh_TYBWEQAkFc59-JmAP8g5Q2SPUoSQ Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Domain-Id: None Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Domain-Name: None Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Identity-Status: Confirmed Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Is-Admin-Project: True Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Domain-Id: default Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Domain-Name: Default Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Name: admin Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Role: reader,member,admin Jun 16 16:34:06.046528 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Roles: reader,member,admin Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f0df30bd71bf4670afbc831b314be545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant: admin Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant-Name: admin Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User: admin Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Domain-Id: default Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Domain-Name: Default Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Id: 55610df78e6e43caada373cf55f4eeb4 Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Name: admin Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: method: > Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: exception: Flavor 42 could not be found. Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: action_args: {'id': '42'} Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:34:06.047978 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:06.048840 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.049972 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-d03c2395-385f-4e0a-bd5a-feb194dae5c5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:34:06.051007 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-d03c2395-385f-4e0a-bd5a-feb194dae5c5 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.078065 Jun 16 16:34:06.051007 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 19/39] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Jun 16 16:34:05 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:34:06.060247 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-a980306d-f2d1-4e9a-a12f-090d7fa48472 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:06.064900 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:34:06.086616 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-a980306d-f2d1-4e9a-a12f-090d7fa48472 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030442 Jun 16 16:34:06.087417 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 21/40] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Jun 16 16:34:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:34:06.097598 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-ff2fe416-f302-4525-a26c-8beb9a19a434 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:06.119514 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-ff2fe416-f302-4525-a26c-8beb9a19a434 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025493 Jun 16 16:34:06.120108 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 20/41] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Jun 16 16:34:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:34:06.130008 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-84b62b9b-4f32-4eb9-ac23-a382305ef901 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:06.138484 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.wsgi [None req-84b62b9b-4f32-4eb9-ac23-a382305ef901 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-84b62b9b-4f32-4eb9-ac23-a382305ef901 admin admin] Request method failure captured: Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Accept: application/json Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Accept-Encoding: gzip, deflate Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Connection: keep-alive Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Content-Length: 0 Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Host: 10.222.0.74 Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Openstack-Api-Version: compute 2.90 Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Openstack-System-Scope: None Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: User-Agent: python-novaclient Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Auth-Token: gAAAAABiq1t9RN1XL4halEr4DfFuQQMRPtplYIDf6r3YxrutGoXIdMZgAxgSa5KswB5y0hqppCcBuKHyNJIGKrLGtKTH4VaPJ70lmbXC9X-0fJYfghPaDeoF4lVe9Ph7Q4ZlG1c-FWcgpgeUg32lK__bZh_TYBWEQAkFc59-JmAP8g5Q2SPUoSQ Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Domain-Id: None Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Domain-Name: None Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Identity-Status: Confirmed Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Is-Admin-Project: True Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Domain-Id: default Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Domain-Name: Default Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Name: admin Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Role: reader,member,admin Jun 16 16:34:06.142232 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Roles: reader,member,admin Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f0df30bd71bf4670afbc831b314be545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant: admin Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant-Name: admin Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User: admin Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Domain-Id: default Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Domain-Name: Default Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Id: 55610df78e6e43caada373cf55f4eeb4 Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Name: admin Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: method: > Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: exception: Flavor 42 could not be found. Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: action_args: {'id': '42'} Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:34:06.143686 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:06.144466 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:06.145478 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-84b62b9b-4f32-4eb9-ac23-a382305ef901 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:34:06.146457 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-84b62b9b-4f32-4eb9-ac23-a382305ef901 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017335 Jun 16 16:34:06.146457 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 22/42] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Jun 16 16:34:06 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:34:07.014493 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-ff2fe416-f302-4525-a26c-8beb9a19a434 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:07.015555 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-ff2fe416-f302-4525-a26c-8beb9a19a434 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 16 16:34:07.015971 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 21/43] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:34:07.217994 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-0412c6a5-cfc3-43be-b2da-1992eef329d1 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:07.223420 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.wsgi [None req-0412c6a5-cfc3-43be-b2da-1992eef329d1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-0412c6a5-cfc3-43be-b2da-1992eef329d1 admin admin] Request method failure captured: Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Accept: application/json Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Accept-Encoding: gzip, deflate Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Connection: keep-alive Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Content-Length: 0 Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Host: 10.222.0.74 Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Openstack-Api-Version: compute 2.90 Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Openstack-System-Scope: None Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: User-Agent: python-novaclient Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Auth-Token: gAAAAABiq1t-6ChJTNS55p6iETT0RKkkqAYoFZmJCmIllIGUdoGy_rFWukopZfh4H7jpn188DCwX-T4iiOBVYA-FuQbpFG2XcnM993pl0mHJCVlL5BtduDi_Dig88mISS2jSFZY4UdoSphzm8JhW06VxIzgQ8uBANzFI9rRNn0L61UDsc2QjHEk Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Domain-Id: None Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Domain-Name: None Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Identity-Status: Confirmed Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Is-Admin-Project: True Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Domain-Id: default Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Domain-Name: Default Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Name: admin Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Role: reader,member,admin Jun 16 16:34:07.224931 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Roles: reader,member,admin Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f0df30bd71bf4670afbc831b314be545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant: admin Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant-Name: admin Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User: admin Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Domain-Id: default Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Domain-Name: Default Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Id: 55610df78e6e43caada373cf55f4eeb4 Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Name: admin Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: method: > Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: exception: Flavor 84 could not be found. Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: action_args: {'id': '84'} Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:34:07.226222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:07.227162 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.228205 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-0412c6a5-cfc3-43be-b2da-1992eef329d1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:34:07.229231 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-0412c6a5-cfc3-43be-b2da-1992eef329d1 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.072886 Jun 16 16:34:07.229231 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 23/44] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Jun 16 16:34:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:34:07.236533 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-0d34b2ee-8039-4d5d-933a-fdc517f29544 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:07.252572 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-0d34b2ee-8039-4d5d-933a-fdc517f29544 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019702 Jun 16 16:34:07.253109 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 22/45] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Jun 16 16:34:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:34:07.263169 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-b39f4bab-ee61-4699-9bf8-ea5f0ec3bb25 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:07.277059 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-b39f4bab-ee61-4699-9bf8-ea5f0ec3bb25 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017427 Jun 16 16:34:07.277588 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 24/46] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Jun 16 16:34:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:34:07.287082 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-f5f7bf7a-1e29-4a44-9bab-d8e6d3838a03 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:07.293050 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.wsgi [None req-f5f7bf7a-1e29-4a44-9bab-d8e6d3838a03 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-f5f7bf7a-1e29-4a44-9bab-d8e6d3838a03 admin admin] Request method failure captured: Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Accept: application/json Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Accept-Encoding: gzip, deflate Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Connection: keep-alive Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Content-Length: 0 Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Host: 10.222.0.74 Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Openstack-Api-Version: compute 2.90 Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Openstack-System-Scope: None Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: User-Agent: python-novaclient Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Auth-Token: gAAAAABiq1t-6ChJTNS55p6iETT0RKkkqAYoFZmJCmIllIGUdoGy_rFWukopZfh4H7jpn188DCwX-T4iiOBVYA-FuQbpFG2XcnM993pl0mHJCVlL5BtduDi_Dig88mISS2jSFZY4UdoSphzm8JhW06VxIzgQ8uBANzFI9rRNn0L61UDsc2QjHEk Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Domain-Id: None Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Domain-Name: None Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Identity-Status: Confirmed Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Is-Admin-Project: True Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Domain-Id: default Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Domain-Name: Default Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Name: admin Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Role: reader,member,admin Jun 16 16:34:07.294553 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Roles: reader,member,admin Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f0df30bd71bf4670afbc831b314be545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant: admin Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant-Name: admin Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User: admin Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Domain-Id: default Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Domain-Name: Default Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Id: 55610df78e6e43caada373cf55f4eeb4 Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Name: admin Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: method: > Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: exception: Flavor 84 could not be found. Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: action_args: {'id': '84'} Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:34:07.296159 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:07.297128 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:07.298465 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-f5f7bf7a-1e29-4a44-9bab-d8e6d3838a03 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:34:07.299781 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-f5f7bf7a-1e29-4a44-9bab-d8e6d3838a03 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012655 Jun 16 16:34:07.299781 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 23/47] 10.222.0.74 () {60 vars in 1190 bytes} [Thu Jun 16 16:34:07 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:34:08.165050 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-b39f4bab-ee61-4699-9bf8-ea5f0ec3bb25 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:08.166095 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-b39f4bab-ee61-4699-9bf8-ea5f0ec3bb25 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jun 16 16:34:08.166506 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 25/48] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:08.365790 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-5f7b1ee8-842b-4c2a-b390-6d30d5e7b2c1 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:08.371793 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.wsgi [None req-5f7b1ee8-842b-4c2a-b390-6d30d5e7b2c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-5f7b1ee8-842b-4c2a-b390-6d30d5e7b2c1 admin admin] Request method failure captured: Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Accept: application/json Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Accept-Encoding: gzip, deflate Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Connection: keep-alive Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Content-Length: 0 Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Host: 10.222.0.74 Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Openstack-Api-Version: compute 2.90 Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Openstack-System-Scope: None Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: User-Agent: python-novaclient Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Auth-Token: gAAAAABiq1uA34PqDF8hCcjLlKYIBvBKEBAw9IDepOTviFtQptoHZUlK2PXiWSHgyfjv2NIb5p68vDgIBm9EV6OSY2qd6xIgD8xYjeUpq-FzS1siwn0gU7r1nioCKQ8LQGTyIvZ8veRFrrGOoMY0tqsEkNLHBkrLrVOZGRL51KgLJiRMVjKnYj8 Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Domain-Id: None Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Domain-Name: None Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Identity-Status: Confirmed Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Is-Admin-Project: True Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Domain-Id: default Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Domain-Name: Default Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Project-Name: admin Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Role: reader,member,admin Jun 16 16:34:08.373212 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Roles: reader,member,admin Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f0df30bd71bf4670afbc831b314be545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant: admin Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-Tenant-Name: admin Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User: admin Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Domain-Id: default Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Domain-Name: Default Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Id: 55610df78e6e43caada373cf55f4eeb4 Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: X-User-Name: admin Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: method: > Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: exception: Flavor 451 could not be found. Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: action_args: {'id': '451'} Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:34:08.374681 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:08.375650 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.376732 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-5f7b1ee8-842b-4c2a-b390-6d30d5e7b2c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109730) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:34:08.377753 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-5f7b1ee8-842b-4c2a-b390-6d30d5e7b2c1 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060740 Jun 16 16:34:08.377753 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 24/49] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Jun 16 16:34:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:34:08.384685 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-782158e5-db4c-4143-ba6c-943f428c9075 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:08.398379 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-782158e5-db4c-4143-ba6c-943f428c9075 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017752 Jun 16 16:34:08.398875 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 26/50] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Jun 16 16:34:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:34:08.411030 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:08.426940 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021629 Jun 16 16:34:08.427521 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 25/51] 10.222.0.74 () {60 vars in 1210 bytes} [Thu Jun 16 16:34:08 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:34:08.437125 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-fdcd07ef-4592-4ed8-96d6-26a18efcc90c admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:08.442770 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.wsgi [None req-fdcd07ef-4592-4ed8-96d6-26a18efcc90c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-fdcd07ef-4592-4ed8-96d6-26a18efcc90c admin admin] Request method failure captured: Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Accept: application/json Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Accept-Encoding: gzip, deflate Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Connection: keep-alive Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Content-Length: 0 Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Host: 10.222.0.74 Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Openstack-Api-Version: compute 2.90 Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Openstack-System-Scope: None Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: User-Agent: python-novaclient Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Auth-Token: gAAAAABiq1uA34PqDF8hCcjLlKYIBvBKEBAw9IDepOTviFtQptoHZUlK2PXiWSHgyfjv2NIb5p68vDgIBm9EV6OSY2qd6xIgD8xYjeUpq-FzS1siwn0gU7r1nioCKQ8LQGTyIvZ8veRFrrGOoMY0tqsEkNLHBkrLrVOZGRL51KgLJiRMVjKnYj8 Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Domain-Id: None Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Domain-Name: None Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Identity-Status: Confirmed Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Is-Admin-Project: True Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Openstack-Nova-Api-Version: 2.90 Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Domain-Id: default Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Domain-Name: Default Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Project-Name: admin Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Role: reader,member,admin Jun 16 16:34:08.444322 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Roles: reader,member,admin Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/f0df30bd71bf4670afbc831b314be545"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_f0df30bd71bf4670afbc831b314be545"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant: admin Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant-Id: f0df30bd71bf4670afbc831b314be545 Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-Tenant-Name: admin Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User: admin Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Domain-Id: default Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Domain-Name: Default Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Id: 55610df78e6e43caada373cf55f4eeb4 Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: X-User-Name: admin Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: method: > Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: exception: Flavor 451 could not be found. Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: action_args: {'id': '451'} Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:34:08.445848 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:08.446731 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: ERROR nova.api.openstack.wsgi Jun 16 16:34:08.448078 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-fdcd07ef-4592-4ed8-96d6-26a18efcc90c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:34:08.449064 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-fdcd07ef-4592-4ed8-96d6-26a18efcc90c admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012200 Jun 16 16:34:08.449064 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 27/52] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Jun 16 16:34:08 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 16 16:34:09.319903 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:09.321142 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001807 Jun 16 16:34:09.321551 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 26/53] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:09.518700 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-c710ffec-67bf-4dff-9111-ed0bb8f75f11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:09.543317 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-c710ffec-67bf-4dff-9111-ed0bb8f75f11 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083787 Jun 16 16:34:09.543786 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 28/54] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Jun 16 16:34:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:34:10.455459 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:10.456501 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 16 16:34:10.456894 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 27/55] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:10.658333 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-90c24870-2300-4eaf-9cd7-6a8d6fa07362 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:10.677605 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-90c24870-2300-4eaf-9cd7-6a8d6fa07362 admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077639 Jun 16 16:34:10.678133 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 29/56] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Jun 16 16:34:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:34:11.550402 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:11.551448 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jun 16 16:34:11.551844 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 28/57] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:11.751882 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-73a14505-9b91-49b1-9154-4abf3f03ddcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:11.772579 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-73a14505-9b91-49b1-9154-4abf3f03ddcc admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.082918 Jun 16 16:34:11.773175 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 30/58] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Jun 16 16:34:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:34:12.638887 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:12.639941 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 16 16:34:12.640308 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 29/59] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:12.830936 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-9da387cb-660e-4614-be66-370ca792ccfc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:34:12.850390 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-9da387cb-660e-4614-be66-370ca792ccfc admin admin] 10.222.0.74 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073721 Jun 16 16:34:12.850967 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 31/60] 10.222.0.74 () {64 vars in 1235 bytes} [Thu Jun 16 16:34:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:34:13.760318 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:13.761361 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 16 16:34:13.761971 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 30/61] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:34:13.964090 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-bc56d8cf-6200-46c1-bd72-4c05324b7d87 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:34:13.986077 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-bc56d8cf-6200-46c1-bd72-4c05324b7d87 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078867 Jun 16 16:34:13.986777 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 32/62] 10.222.0.74 () {60 vars in 1202 bytes} [Thu Jun 16 16:34:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:35:02.640497 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:35:02.641597 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-c7112464-b3a3-49ea-832d-c9253267c007 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Jun 16 16:35:02.642046 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 31/63] 10.222.0.74 () {54 vars in 930 bytes} [Thu Jun 16 16:35:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:35:02.653673 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:35:02.713800 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-4c3a9e0a-cc47-4e88-84d0-0ad6bec0146d admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:35:02.736257 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-4c3a9e0a-cc47-4e88-84d0-0ad6bec0146d admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.087266 Jun 16 16:35:02.736819 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 33/64] 10.222.0.74 () {60 vars in 1291 bytes} [Thu Jun 16 16:35:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:35:02.761572 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-48cfd131-d6b3-47e8-b86a-3222646609e4 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:35:02.767179 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG dbcounter [-] [109730] Writing DB stats nova_api:SELECT=14 {{(pid=109730) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:35:02.772634 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-48cfd131-d6b3-47e8-b86a-3222646609e4 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014785 Jun 16 16:35:02.773200 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 32/65] 10.222.0.74 () {60 vars in 1282 bytes} [Thu Jun 16 16:35:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:35:02.785895 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-b6fa1d30-4a3b-4b6f-8424-3ef00dea521e admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:35:02.800099 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-b6fa1d30-4a3b-4b6f-8424-3ef00dea521e admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017885 Jun 16 16:35:02.800909 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 34/66] 10.222.0.74 () {60 vars in 1285 bytes} [Thu Jun 16 16:35:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:35:02.814794 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:35:02.823710 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013915 Jun 16 16:35:02.824286 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 33/67] 10.222.0.74 () {60 vars in 1285 bytes} [Thu Jun 16 16:35:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:35:02.838832 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-692ab589-91dc-4e5f-a955-78eb25e2d06b admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:35:02.847222 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-692ab589-91dc-4e5f-a955-78eb25e2d06b admin admin] 10.222.0.74 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012252 Jun 16 16:35:02.847753 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 35/68] 10.222.0.74 () {60 vars in 1282 bytes} [Thu Jun 16 16:35:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:38:29.573834 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:29.574889 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jun 16 16:38:29.575336 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 34/69] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:38:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:38:29.730336 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_api:SELECT=6 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:29.858087 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-ebef77f6-4887-42dd-a7fb-dc3597b19ab4 admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:29.859313 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:38:29.859313 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: warnings.warn(msg) Jun 16 16:38:29.860606 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-ebef77f6-4887-42dd-a7fb-dc3597b19ab4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:29.861055 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-ebef77f6-4887-42dd-a7fb-dc3597b19ab4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:29.861885 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-ebef77f6-4887-42dd-a7fb-dc3597b19ab4 admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:29.862297 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-ebef77f6-4887-42dd-a7fb-dc3597b19ab4 admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:29.898736 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-ebef77f6-4887-42dd-a7fb-dc3597b19ab4 admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.169938 Jun 16 16:38:29.899338 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 36/70] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Jun 16 16:38:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:38:30.768640 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:30.769655 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 16 16:38:30.770078 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 35/71] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:38:30.975335 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-7122074f-7ff4-4479-bb53-15236be422be admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:30.976294 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:38:30.976294 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: warnings.warn(msg) Jun 16 16:38:30.977480 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-7122074f-7ff4-4479-bb53-15236be422be admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:30.977917 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-7122074f-7ff4-4479-bb53-15236be422be admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:30.978684 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-7122074f-7ff4-4479-bb53-15236be422be admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:30.979105 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-7122074f-7ff4-4479-bb53-15236be422be admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:30.998961 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-7122074f-7ff4-4479-bb53-15236be422be admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.087149 Jun 16 16:38:30.999577 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 37/72] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Jun 16 16:38:30 2022] GET /compute/v2.1/os-services => generated 791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:38:42.351943 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:42.352954 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 16 16:38:42.353369 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 36/73] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:38:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:38:42.496468 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_cell0:SELECT=4 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:42.497208 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_cell1:SELECT=4 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:42.497885 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG dbcounter [-] [109731] Writing DB stats nova_api:SELECT=8 {{(pid=109731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:38:42.547329 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-a7421d55-39bd-4f3a-beab-c0fea7b8289c admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:42.548481 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:38:42.548481 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: warnings.warn(msg) Jun 16 16:38:42.550129 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-a7421d55-39bd-4f3a-beab-c0fea7b8289c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:42.550129 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-a7421d55-39bd-4f3a-beab-c0fea7b8289c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:42.550809 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-a7421d55-39bd-4f3a-beab-c0fea7b8289c admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:42.551248 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-a7421d55-39bd-4f3a-beab-c0fea7b8289c admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:42.577175 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-a7421d55-39bd-4f3a-beab-c0fea7b8289c admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085244 Jun 16 16:38:42.577643 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 38/74] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Jun 16 16:38:42 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:38:43.462443 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: DEBUG nova.api.openstack.wsgi [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] Calling method '>' {{(pid=109730) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:43.463486 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: INFO nova.api.openstack.requestlog [None req-09e653d9-64ad-4987-8478-ae3a4c8e2ef9 admin admin] 10.222.0.74 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jun 16 16:38:43.463876 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: [pid: 109730|app: 0|req: 37/75] 10.222.0.74 () {56 vars in 1074 bytes} [Thu Jun 16 16:38:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:38:43.668541 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG nova.api.openstack.wsgi [None req-142e4026-48fb-4cc4-a8b5-2ebdd822ff9e admin admin] Calling method '>' {{(pid=109731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:38:43.669629 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 16:38:43.669629 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: warnings.warn(msg) Jun 16 16:38:43.670801 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-142e4026-48fb-4cc4-a8b5-2ebdd822ff9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:43.671265 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-142e4026-48fb-4cc4-a8b5-2ebdd822ff9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:43.672024 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-142e4026-48fb-4cc4-a8b5-2ebdd822ff9e admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:38:43.672438 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: DEBUG oslo_concurrency.lockutils [None req-142e4026-48fb-4cc4-a8b5-2ebdd822ff9e admin admin] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:38:43.693789 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: INFO nova.api.openstack.requestlog [None req-142e4026-48fb-4cc4-a8b5-2ebdd822ff9e admin admin] 10.222.0.74 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092640 Jun 16 16:38:43.694338 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: [pid: 109731|app: 0|req: 39/76] 10.222.0.74 () {60 vars in 1193 bytes} [Thu Jun 16 16:38:43 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:39:43.936606 dv-cinder-837355-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 16 16:39:43.937253 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: Thu Jun 16 16:39:43 2022 - graceful shutdown triggered... Jun 16 16:39:43.937724 dv-cinder-837355-2-iscsi devstack@n-api.service[109730]: Gracefully killing worker 1 (pid: 109730)... Jun 16 16:39:43.938308 dv-cinder-837355-2-iscsi devstack@n-api.service[109731]: Gracefully killing worker 2 (pid: 109731)... Jun 16 16:39:44.938148 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: worker 1 buried after 1 seconds Jun 16 16:39:44.938148 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: worker 2 buried after 1 seconds Jun 16 16:39:44.938148 dv-cinder-837355-2-iscsi devstack@n-api.service[109729]: goodbye to uWSGI. Jun 16 16:39:44.939900 dv-cinder-837355-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 16 16:39:44.940461 dv-cinder-837355-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 16 16:39:44.943346 dv-cinder-837355-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 16 16:39:44.956124 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 16:39:44 2022] *** Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: nodename: dv-cinder-837355-2-iscsi Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: machine: x86_64 Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: clock source: unix Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: pcre jit disabled Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: detected number of CPU cores: 4 Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: current working directory: / Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: detected binary path: /usr/bin/uwsgi-core Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: your processes number limit is 47680 Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: your memory page size is 4096 bytes Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: detected max file descriptor number: 2048 Jun 16 16:39:44.958459 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: lock engine: pthread robust mutexes Jun 16 16:39:44.960232 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: thunder lock: enabled Jun 16 16:39:44.960232 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 16 16:39:44.960232 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 16:39:45.003130 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: Python main interpreter initialized at 0x5561a55e39c0 Jun 16 16:39:45.003130 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: python threads support enabled Jun 16 16:39:45.003130 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: your server socket listen backlog is limited to 100 connections Jun 16 16:39:45.003130 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: your mercy for graceful operations on workers is 90 seconds Jun 16 16:39:45.003557 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 16:39:45.003557 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: *** Operational MODE: preforking *** Jun 16 16:39:45.003880 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: *** uWSGI is running in multiple interpreter mode *** Jun 16 16:39:45.003880 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: spawned uWSGI master process (pid: 124088) Jun 16 16:39:45.006960 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: spawned uWSGI worker 1 (pid: 124103, cores: 1) Jun 16 16:39:45.006960 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: spawned uWSGI worker 2 (pid: 124104, cores: 1) Jun 16 16:39:45.006960 dv-cinder-837355-2-iscsi devstack@n-api.service[124088]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 16:39:45.004080 dv-cinder-837355-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 16 16:39:45.678564 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:39:45.691622 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 16 16:39:46.948385 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:39:46.948385 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: from cryptography.utils import int_from_bytes Jun 16 16:39:46.949083 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:39:46.949083 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: from cryptography.utils import int_from_bytes Jun 16 16:39:46.988214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:39:46.988214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: from cryptography.utils import int_from_bytes Jun 16 16:39:46.988874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 16:39:46.988874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: from cryptography.utils import int_from_bytes Jun 16 16:39:49.449649 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:39:49.450330 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:39:49.450638 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:39:49.450948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:39:49.451307 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:39:49.451709 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.452038 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.452364 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.452685 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.453015 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.453325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.453653 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.453972 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.454308 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.454561 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.454869 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.455230 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837355-2-iscsi {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.455560 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.455857 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.456163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.456488 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.456795 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.457161 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.457438 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.457915 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.461962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.462719 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.462719 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.462719 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837355-2-iscsi {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.462719 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.462719 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.462719 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.463335 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.463335 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.463531 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.464128 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.464128 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.464675 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.464930 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.465205 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.465571 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.465978 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.466300 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.466795 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.466795 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.467378 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.467378 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.467913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.467913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.469165 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.469165 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.469165 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.469165 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.469468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.469559 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.469838 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.470159 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.470468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.470777 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.471097 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.471421 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.471714 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.472023 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.472328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.472633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.472956 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.473276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.473775 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.474092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.476116 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.476468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.476732 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.477055 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.477416 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.477748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.478071 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.478403 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.478734 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.479084 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.479474 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.479829 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.480157 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.480509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.480815 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.481108 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.481423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.481741 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.482062 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.482372 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.482681 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.482992 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.483401 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.483716 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.484023 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.484332 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.484640 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.484948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.485259 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.485567 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.485875 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.486184 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.486509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.486836 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.487170 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.487482 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.487788 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.488096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.488421 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.488731 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.489036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.489366 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.489677 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.489981 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.490299 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.490607 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.490917 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.491267 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.491566 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.491878 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.492201 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.492511 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.492815 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.493120 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.493422 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.493726 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.494031 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.494334 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.494638 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.494939 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.495286 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.495610 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.495921 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.496230 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.496559 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.496965 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.497573 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.498167 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.498841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.499202 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.499554 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.501490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.501490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.501490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.501490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.501490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.501490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.502447 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.502447 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.502447 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.503244 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.503410 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.504149 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.504149 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.504455 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.504606 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.504859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.505189 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.505516 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.505832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.506178 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.506528 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.507002 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.508748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.509100 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.509813 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.509813 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.510240 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.510453 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.510725 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.511300 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.511845 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.512484 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.513151 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.513587 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.514007 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.514275 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.514591 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.514921 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.515278 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.515600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.515925 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.516248 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.516569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.516885 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.517200 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.517510 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.517828 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.518136 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.518449 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.518775 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.519144 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.519456 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.519797 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.520106 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.520416 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.520728 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.521046 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.521359 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.521659 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.522058 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.522308 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.522579 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.522892 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.523227 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.523578 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.524247 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.524247 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.524776 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.524776 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.525067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.525516 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.525685 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.525991 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.526291 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.526604 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.526935 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.527299 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.527605 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.528037 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.528338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.528658 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.528962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.529898 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.529898 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.530190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.530341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.530629 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.535092 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.536883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.538465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.538465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.538465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.538465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.539263 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.539440 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.539650 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.540039 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.540374 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.540863 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.541272 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.541597 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.542056 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.542238 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.542557 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.542908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.543280 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.543679 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.544011 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.544331 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.544784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.545417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.545417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.545951 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.546246 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.546442 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.546650 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.546978 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.547320 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.547656 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.547969 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.548293 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.548601 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.548940 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.549257 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.549599 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.549911 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.550230 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.550550 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.550864 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.551197 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.551514 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.551823 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.552212 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.552444 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.552761 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.553115 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.553848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.553848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.554047 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.554268 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.554571 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.554875 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.555213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.555536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.555849 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.556172 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.556491 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.556795 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.557100 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.557423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.557738 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.558041 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.558345 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.558655 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.558998 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.559389 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.559690 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.560011 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.560333 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.560644 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.560960 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.561271 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.561580 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.561904 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.562224 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.562537 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.562845 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.563184 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.563492 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.563803 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.564126 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.564433 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.564744 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.565052 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.565355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.567664 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.568019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.568642 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.569041 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.569372 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.569701 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.570027 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.570355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.570691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.571087 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.571436 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.571749 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.573186 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.573186 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.573186 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.573186 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.573832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.573832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.574119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.574276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.574576 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.574991 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.576355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.576355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.576355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.576355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.577129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.577129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.577289 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.577592 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.577898 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.578206 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.578509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.578856 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.579531 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.579880 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.580215 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.580563 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.580873 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.581181 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.581509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.581851 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.582841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.583177 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.583494 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.583806 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.584118 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.584433 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.584744 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.585055 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.585366 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.585671 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.585981 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.586285 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.586599 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.586972 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.587308 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.587928 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.588244 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.588558 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.588864 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.589175 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.589480 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.589799 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.590104 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.590475 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.590780 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.591131 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.591444 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.591748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.592080 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.592386 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.592693 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.592992 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.593304 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.593605 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.593911 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.594220 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.594542 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.594859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.595188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.595501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.595805 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.596114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.596418 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.596728 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.597038 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.597337 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.597641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.597946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.598249 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.598569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.598884 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.599210 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.599517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.599821 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.600169 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.600477 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.600836 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.600934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 16:39:49.601366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 16:39:49.601459 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.601459 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.601656 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 16:39:49.601757 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.602025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 16:39:49.602125 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.602282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 16:39:49.602433 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.602654 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.602812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.602951 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.603113 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.603282 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.603453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.603615 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.603763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.603913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.604078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.604219 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.604368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.604506 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.604648 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.604816 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.604961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.605125 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.605327 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.605509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.605693 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.605832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.606024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.606283 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.606512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837355-2-iscsi {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.606686 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.606686 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.606913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.607132 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.607299 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.607449 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.607542 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.607758 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.607896 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.608068 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.608172 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.608376 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.608476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.608687 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.608794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.608996 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.609197 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.609320 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.609518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.609624 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.609829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.609934 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.610144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.610243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.610481 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.610597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.610790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.610891 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.611123 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.611264 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.611448 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.611540 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.611760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.611876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.612057 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.612154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.612362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.612493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.612668 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.612801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837355-2-iscsi {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.612977 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.613205 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.613346 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.613534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.613700 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.613849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.614015 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.614266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.614365 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.614582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.614689 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.614892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.614990 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.615237 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.615347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.615551 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.615654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.615862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.615956 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.616165 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.616254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.616515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.616676 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.616839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.616948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.617208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.617391 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.617534 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.617662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.617783 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.617889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.618051 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.618204 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.618362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.618485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.618681 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.618772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.618982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.619159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.619325 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.619414 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.619628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.619737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.619949 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.620121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.620253 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.620344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.620572 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.620669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.620824 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.620987 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.621085 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.621296 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.621394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.621681 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.621854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.622284 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.622418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.622721 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.622863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.623025 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.623211 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.623379 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.623516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.623689 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.623814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.624008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.624138 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.624313 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.624447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.624620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.624716 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.624926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.625025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.625252 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.625393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.625575 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.625724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.625886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.626040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.626200 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.626366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.626501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.626815 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.627110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.74 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.627206 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.627462 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.627593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.74 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.627783 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.628424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.628526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.628815 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.629054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.629154 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.629432 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.629657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.629786 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.630047 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.630247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.630385 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.630641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.630845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.630936 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.631261 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.631441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.631643 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.631948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.632038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.632257 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.632564 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.632654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.632869 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.633137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.633242 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.633461 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.633755 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.633856 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.634076 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.634387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.634486 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.634697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.635018 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.635132 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.635364 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.635523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.635668 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.635989 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.636078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.636296 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.636600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.636740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.636904 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.637258 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.637358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.637610 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.637797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.637919 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.638243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.638402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.638572 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.638903 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.639008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.639240 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.639573 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.639670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.639899 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.640150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.640252 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.640516 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.640821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.640919 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.641129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.641408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.641508 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.641726 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.641994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.642083 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.642315 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.642596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.642687 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.642908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.643212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.643316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.643685 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.643794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.644085 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.644316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.644414 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.644657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.644747 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.645003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.645106 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.645310 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.645401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.645613 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.645713 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.645915 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.646007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.646217 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.646312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.646559 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.646659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.646863 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.646995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.647218 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.647314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.647536 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.647628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.647853 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.647990 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.648171 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.648270 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.648476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.648566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.648799 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.648898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.649113 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.649204 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.649423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.649519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.649737 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.649839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.650046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.650135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.650357 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.650447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.650670 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.650768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.650981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.651102 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.651315 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.651407 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.651621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.651724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.651932 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.652023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.652240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.652336 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.652554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.652870 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.653026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.653213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.653486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.653581 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.653832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.653959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.654144 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.654266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.654457 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.654597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.654768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.654917 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.655099 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.655256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.655410 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.655554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.655720 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.655877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 16:39:49.656027 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.656226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.656354 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.656568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.656670 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.656921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.657056 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.657244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.657367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.657587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.657680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.657908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.657998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.658222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.658323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.658534 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.658739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.658891 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.659236 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.659340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.659543 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.659855 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.659945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.660171 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.660485 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.660575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.660798 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.661089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.661187 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.661402 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.661692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.661790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.662015 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.662288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.662380 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.662623 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.662873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.662978 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.663273 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.663502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.663596 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.663920 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.664099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.664233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.664546 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.664701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.664860 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.665314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.665411 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.665679 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.665910 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.666009 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.666321 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.666518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.666642 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.666959 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.667202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.667320 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.667611 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.667826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.667932 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.668203 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.668326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.668538 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.668705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.668843 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.669148 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.669320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.669466 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.669662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.669773 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.670008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.670112 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.670368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.670497 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.670676 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.670774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.671029 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.671236 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.671381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.671589 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.671717 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.671906 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.672062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.672232 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.672384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.672555 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.672718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.672873 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.673039 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.673179 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.673358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.673490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.673677 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.673797 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.673994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.674086 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.674311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.674428 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.674655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.674782 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.674977 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.675089 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.675305 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.675406 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.675614 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.675723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.675923 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.676014 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.676225 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.676358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.676532 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.676637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.676832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.676931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.677150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.677239 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.677454 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.677601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.677757 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.677848 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.678060 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.678151 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.678367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.678499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.678666 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.678757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.678983 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.679119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.679294 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.679395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.679596 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.679696 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.679909 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.680011 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.680211 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.680303 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.680520 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.680620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.680824 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.680914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.681133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.681226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.681435 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.681527 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.681742 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.681834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.682055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.682159 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.682387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.682479 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.682701 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.682799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.683002 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.683186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.683348 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.683455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.683656 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.683755 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.683964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.684144 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.684324 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.684532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.684624 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.684966 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.685120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.685281 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.685500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.685822 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.685922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.686143 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.686236 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.686465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.686563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.686787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.686890 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.687130 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.687226 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.687449 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.687580 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.687754 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.687857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.688058 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.688155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.688380 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.688479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.688689 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.688828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.688997 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.689092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.689307 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.689397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.689615 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.689714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.689921 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.690012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.690230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.690327 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.690536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.690633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.690843 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.690933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.691173 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.691278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.691480 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.691573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.691786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.691876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.692091 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.692181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.692396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.692486 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.692705 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.692803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.693024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.693126 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.693329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.693429 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.693636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.693769 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.693941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.694046 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.694256 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.694352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.694565 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.694707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.694873 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.695201 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.695383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.695511 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.695824 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.696014 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.696152 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.696464 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.696600 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.696765 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.697192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.697284 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.697499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.697757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.697888 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.698121 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.698340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.698439 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.698734 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.698915 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.699118 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.699377 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.699534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.699813 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.700028 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.700128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.700356 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.700695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.700788 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.701021 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.701319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.701412 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.701635 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.701922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.702013 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.702227 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.702534 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.702631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.702848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.702938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.703189 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.703297 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.703493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.703594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.703793 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.703932 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.704098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.704197 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.704397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.704520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.704699 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.704869 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.705000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.705212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.705347 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.705543 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.705643 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.705877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.705970 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.706177 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.706273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.706477 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.706569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.706777 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.706878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.707144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.707247 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.707462 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.707601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.707768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.707863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.708068 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.708169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.708370 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.708470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.708670 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.708762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.708972 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.709069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.709274 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.709378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.709605 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.709697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.709931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.710022 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.710243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.710346 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.710561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.710653 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.710868 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.710971 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.711211 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.711317 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.711520 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.711618 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.711838 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.711930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.712160 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.712252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.712476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.712566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.712785 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.712875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.713095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.713186 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.713405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.713495 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.713714 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.713811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.714025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.714114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.714330 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.714464 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.714637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.714743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.714945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.715036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.715442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.715587 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.715821 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.716041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.716132 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.716399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.716501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.716742 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.716832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.717065 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.717164 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.717383 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.717649 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.717743 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.718009 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.718113 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.718317 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.718588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.718688 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.718926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.719135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.719259 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.719557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.719649 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.719871 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.719960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.720186 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.720346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.720513 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.720765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.720857 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.721137 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.721241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.721462 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.721554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.721786 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.721935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.722133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.722289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.722445 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.722764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.722857 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.723145 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.723253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.723462 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.723561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.723772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.723985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.724076 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.724304 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:39:49.724519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.725317 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.725963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.726555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.726968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.727372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.727785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.728146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.728593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.728992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.729353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.729763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.730133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.730561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.731249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.731668 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.732065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.732424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.732840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.733567 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.733966 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.734359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.734796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.735187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.735597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.736055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.736431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.736894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.737300 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.737658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.738055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.738435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.738864 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.739283 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.739638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.740031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.740386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.740818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.741208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.741553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.741988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.742413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.742764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.743180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.743528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.744025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.744656 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.745368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.746019 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.746702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.747169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.747516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.748028 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.748451 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.748840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.749282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.749672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.750048 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.750495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.750881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.751248 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.751658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.752012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.752399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.752801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.753492 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.753889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.754243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.754679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.755117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.755467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.755909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.756272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.757395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.757812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.758174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.758608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.759012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.759394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.759869 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.760362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.761061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.761732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.762434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.763117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.763787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.764480 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.765154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.765852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.766460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.766823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.767305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.767712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.768068 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.768522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.768939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.769306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.769710 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.770133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.770491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.770955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.771329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.771716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.772034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.772392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.772709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.773049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.773359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.773731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.774045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.774396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.774705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.775119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.775471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.775877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.776452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.776865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.777333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.778029 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.778285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.778681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.779313 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.779679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.780007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.780353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.780675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.781028 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.781336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.781695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.782034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.782398 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.782754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.783100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.783448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.783761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.784077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.784417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.784736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.785062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.785391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.785722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.786061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.786371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.786723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.786861 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO dbcounter [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Registered counter for database nova_api Jun 16 16:39:49.787034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.787395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.787707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.788062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.788367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.788745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.789039 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.789389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.789701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.790036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.790344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.790690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.791174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.791493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.791814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.792151 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.792486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.792809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.793159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.793652 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.794140 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.794758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.795228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.795681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.796090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.796422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.796767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.797089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.797483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.797768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.798126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.798468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.798786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.799133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.799459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.799922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.800245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.800564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.801001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.801404 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.801684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.802016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.802367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.802680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.803027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.803372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.803709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.804033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.804399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.804714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.805060 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.805376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.805727 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.806051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.806393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.806745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.807192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.807544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.807854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.808266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.808671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.809325 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.809582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.810019 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.813684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.814252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.814252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.814252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.814252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.814505 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.815291 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.815427 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:49.815604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.816051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.816243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.816596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.816903 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.817249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.817597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.817930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.818250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.818628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.819037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.819315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.819627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.820106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.820450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.820771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.821144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.821447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.821809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.822118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.822470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.822772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.823098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.823411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.823762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.824062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.824395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.824900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.825214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.825460 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:49.825616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.825934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.826358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.826764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.827261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.827685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.828143 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.828489 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.828845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.829169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.829642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.829866 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.830204 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.830526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.830872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.831224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.831550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.831907 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.832220 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.832568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.832909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.833229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.833574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.833936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.834531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.834901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.835277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.835582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.835933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.836260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.836588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.836904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.837249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.837587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.837895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.838261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.838613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.838967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.839418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.839830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.840338 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.840898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.841442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.841831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.842182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.842497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.842901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.843247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.843600 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.843926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.844267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.844608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.844923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.845280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.845592 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.845933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.846251 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.846616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.846956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.847376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.847720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.848046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.848403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.848962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.849276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.849645 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.850131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.850621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.851143 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.851696 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.852271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.852814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.853461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.854070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.854692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.855231 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.855565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.855994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.856314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.856741 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.856995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.857596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.857964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.858314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.858653 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.859102 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.859347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.859663 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.860023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.860361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.860667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.861023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.861333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.861666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.861971 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.862321 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.862636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.862970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.863305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.863654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.863979 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.864312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.864617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.864969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.865283 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.865607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.865909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.866259 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.866561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.866900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.867224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.867576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.867883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.868208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.868526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.868927 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.869378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.869805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.870265 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.870730 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.871112 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.871573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.871938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.872255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.872578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.872969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.873319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.873870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.874247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.874568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.874935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.875314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.875640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.875975 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.876279 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.876648 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.876971 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.877308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.877617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.878279 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.878585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.878926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.879256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.879627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.879943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.880280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.880585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.880935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.881245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.881582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.881923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.882286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.882609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.882946 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.883311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.883630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.883968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.884274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.884662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.885006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.885441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.885953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.886369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.886940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.887471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.887790 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.888309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.888623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.889122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.889620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.890094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.890597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.891093 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.891626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.892158 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.892670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.893181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.893661 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.894142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.894614 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.895123 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.895648 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.896168 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.896672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.897155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.897625 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.898087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.898555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.899023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.899515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.900018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.900505 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.900997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.901500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.902003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.902478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.903004 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.903501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.903962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.904424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.904880 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.905338 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.905796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.906334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.906843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.907015 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.context [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2503fb0-10e9-49f5-9aa8-746908a7d718(cell1) {{(pid=124103) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:39:49.907351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.907843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.908316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.908801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.909269 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.909752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.910243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.910720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.911217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.911722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.912194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.912412 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:49.912666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.913133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.913633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.914134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.914361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:49.915311 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:49.915450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.915964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.916451 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.916920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.917470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.917683 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:49.918036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.918697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.919291 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.919881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.920465 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.920651 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO dbcounter [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Registered counter for database nova_cell0 Jun 16 16:39:49.921122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.921676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.922244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.922793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.923384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.923968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.925222 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.925222 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.925222 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.925518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.925716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.926057 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.926414 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.926735 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.926964 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO dbcounter [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Registered counter for database nova_cell1 Jun 16 16:39:49.927086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.927428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.927752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.928206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.928512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 16:39:49.928764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 16:39:49.938159 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:49.939906 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:49.948009 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:49.948135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:50.005759 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO dbcounter [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Registered counter for database nova_api Jun 16 16:39:50.026651 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:50.033774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:50.099994 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO dbcounter [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Registered counter for database nova_cell0 Jun 16 16:39:50.104750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.context [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),a2503fb0-10e9-49f5-9aa8-746908a7d718(cell1) {{(pid=124104) load_cells /opt/stack/nova/nova/context.py:464}} Jun 16 16:39:50.109568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:50.111210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:50.112040 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_db.sqlalchemy.engines [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:50.112168 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:39:50.114348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:39:50.116449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO dbcounter [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Registered counter for database nova_cell0 Jun 16 16:39:50.117911 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writer thread running {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:50.120499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO dbcounter [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Registered counter for database nova_cell1 Jun 16 16:39:50.129217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:50.130540 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:50.136970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:50.278853 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:50.288607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO dbcounter [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Registered counter for database nova_cell0 Jun 16 16:39:50.299626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_db.sqlalchemy.engines [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 16:39:50.304831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writer thread running {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 16:39:50.487541 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:39:50.495782 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:39:50.622422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:39:50.630126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:39:50.882090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:39:50.888324 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: WARNING keystonemiddleware.auth_token [None req-b179afc7-7fc1-40e3-849b-c6ca4cf681d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:39:50.893643 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561a55e39c0 pid: 124103 (default app) Jun 16 16:39:50.975399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 16 16:39:50.981478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: WARNING keystonemiddleware.auth_token [None req-3c535132-6366-4099-b0f1-7897196cf9b2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 16 16:39:50.986771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561a55e39c0 pid: 124104 (default app) Jun 16 16:40:31.342435 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:31.343313 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:31.343982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:31.344727 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:31.413055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:31.414861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:31.416055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:31.417403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:33.035851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cef83089-2567-4c6b-aecc-7d42f44c35d6 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Action: 'create', calling method: .version_select at 0x7fe5faa4b700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1318457865"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:33.148038 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6dc06b82-8f70-4381-8c44-00af98bb701e tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Action: 'create', calling method: .version_select at 0x7fe5faa46790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1125104565", "metadata": {"Type": "work"}}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:35.333455 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6dc06b82-8f70-4381-8c44-00af98bb701e tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.044775 Jun 16 16:40:35.333455 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 1/1] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Jun 16 16:40:31 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4047 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 16:40:35.345555 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2b16ee0b-86e0-469b-99d4-a3c790649587 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90f5e0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:35.347715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cef83089-2567-4c6b-aecc-7d42f44c35d6 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.939249 Jun 16 16:40:35.348794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 1/2] 10.222.0.74 () {60 vars in 1154 bytes} [Thu Jun 16 16:40:31 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3949 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 16 16:40:35.361205 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-09be97e2-fd4d-4be9-8a81-76bacd20b8d3 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa90f550>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:35.825854 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2b16ee0b-86e0-469b-99d4-a3c790649587 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.484509 Jun 16 16:40:35.826965 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 2/3] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:35 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:35.926311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-09be97e2-fd4d-4be9-8a81-76bacd20b8d3 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.569583 Jun 16 16:40:35.926926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 2/4] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:35 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:40:36.838756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b6cc2a93-85ca-487f-92f3-6ada113e26ce tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90f940>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:36.940385 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2170ac44-5ad2-4c37-9bc5-abf69b4c5295 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa90f820>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:37.032179 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b6cc2a93-85ca-487f-92f3-6ada113e26ce tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.178927 Jun 16 16:40:37.032179 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 3/5] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:36 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:37.138356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2170ac44-5ad2-4c37-9bc5-abf69b4c5295 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 346 microversion: 2.1 time: 0.202050 Jun 16 16:40:37.138941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 3/6] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:36 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:37.151264 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4619c3bf-7c76-4df4-8bcb-9bed2567bbf3 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Action: 'create', calling method: .version_select at 0x7fe5fa90fd30>, body: {"snapshot": {"volume_id": "7c8c8cc3-79b1-49bd-995b-ca481953a296", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1128741676"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:37.652007 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4619c3bf-7c76-4df4-8bcb-9bed2567bbf3 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.505615 Jun 16 16:40:37.652841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 4/7] 10.222.0.74 () {60 vars in 1161 bytes} [Thu Jun 16 16:40:37 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:37.666089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-290c7f60-c0c3-4250-9f5c-9fcf9f1d1744 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa90fd30>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:37.824938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-290c7f60-c0c3-4250-9f5c-9fcf9f1d1744 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.164569 Jun 16 16:40:37.826051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 4/8] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:37 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:37.836251 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-626cf87b-9770-4bda-b05d-fde69448d3e7 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa926940>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:37.921208 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-626cf87b-9770-4bda-b05d-fde69448d3e7 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.089324 Jun 16 16:40:37.922071 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 5/9] 10.222.0.74 () {58 vars in 1139 bytes} [Thu Jun 16 16:40:37 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:37.932838 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ff2453a8-f5d1-4809-b6c3-38f96f41258c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa9274c0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:37.990038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ff2453a8-f5d1-4809-b6c3-38f96f41258c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.061089 Jun 16 16:40:37.991033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 5/10] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:37 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:38.026988 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-98c69eaf-b5fc-40ee-8ff2-fd3b02c430b1 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa926700>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:38.172748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-98c69eaf-b5fc-40ee-8ff2-fd3b02c430b1 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 354 microversion: 2.1 time: 0.149917 Jun 16 16:40:38.174553 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 6/11] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:38 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:38.187715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-90312284-e02f-4d20-98c9-70fad3acaab6 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90fd30>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:38.328433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-90312284-e02f-4d20-98c9-70fad3acaab6 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 354 microversion: 2.1 time: 0.144607 Jun 16 16:40:38.336522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 6/12] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:38 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 354 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:38.342105 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9d0209a0-cd55-4fcd-b47a-7e380696619b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa9260d0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:38.486964 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9d0209a0-cd55-4fcd-b47a-7e380696619b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 202 len: 0 microversion: 2.1 time: 0.149333 Jun 16 16:40:38.488005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 7/13] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:40:38 2022] DELETE /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:40:38.506054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6e979da4-d652-405f-be1f-e837f1d8723b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90f8b0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:38.604475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6e979da4-d652-405f-be1f-e837f1d8723b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.110495 Jun 16 16:40:38.615720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 7/14] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:38 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:39.008042 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e4322dd1-dbd7-471d-9f20-91ba4b005e32 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa90fe50>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:39.270242 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e4322dd1-dbd7-471d-9f20-91ba4b005e32 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.271985 Jun 16 16:40:39.271154 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 8/15] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:38 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:39.621922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-35400e9b-babf-4727-95d5-b575dba0bf23 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa927670>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:39.754213 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-35400e9b-babf-4727-95d5-b575dba0bf23 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.139092 Jun 16 16:40:39.755793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 8/16] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:39 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:40.282598 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c784e2ac-e5ff-4edf-af45-5ee6d61dfc6d tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa926d30>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:40.334114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c784e2ac-e5ff-4edf-af45-5ee6d61dfc6d tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.055912 Jun 16 16:40:40.334620 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 9/17] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:40 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:40.770636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a1e385c3-ff2e-4a2c-b20b-e111fc31c37f tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90f820>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:40.880889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a1e385c3-ff2e-4a2c-b20b-e111fc31c37f tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.117579 Jun 16 16:40:40.882037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 9/18] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:40 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:41.347259 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-04cea6cf-8f9c-4d40-ba0e-658e850bb547 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa926790>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:41.397774 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-04cea6cf-8f9c-4d40-ba0e-658e850bb547 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.055250 Jun 16 16:40:41.399012 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 10/19] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:41 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:41.632659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5ec7adb8-b37a-43a2-a9dd-ee015e1ca157 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: .version_select at 0x7fe5fa90fca0>, body: {"keypair": {"name": "tempest-keypair-1045044092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAWdAAAOX6RCEqmzhguS4MLmja0vNgWiwgvHzqucvZJUrnZy9XW1NCUUGGaantyD/rjgRTk4bpoZzHBk9DlL1I49GapBR09BtzASMyCt7LlvYG5xamBiWPtTsqJevUkMQ=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:41.771811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-5ec7adb8-b37a-43a2-a9dd-ee015e1ca157 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:40:41.794825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-5ec7adb8-b37a-43a2-a9dd-ee015e1ca157 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:40:41.893904 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0474862b-6646-4b40-9fbf-8dc4981eff76 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90f4c0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:41.937264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5ec7adb8-b37a-43a2-a9dd-ee015e1ca157 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.525934 Jun 16 16:40:41.945894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 10/20] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:40:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:40:42.007200 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0474862b-6646-4b40-9fbf-8dc4981eff76 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.117740 Jun 16 16:40:42.007879 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 11/21] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:41 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:40:42.410343 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c114af37-21da-447c-ac7b-7889dc0a03cf tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa88aca0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:42.467345 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c114af37-21da-447c-ac7b-7889dc0a03cf tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.061115 Jun 16 16:40:42.467938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 11/22] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:42 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:40:43.019886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-390a4324-f460-4a35-ad7e-900faa8f96c2 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90f8b0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:43.161166 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-390a4324-f460-4a35-ad7e-900faa8f96c2 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.145258 Jun 16 16:40:43.161918 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 12/23] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:43 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:43.491668 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5edc2354-cc08-4345-9e87-00a99092993b tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa88aee0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:43.660915 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5edc2354-cc08-4345-9e87-00a99092993b tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.182362 Jun 16 16:40:43.661718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 12/24] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:43 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:44.173981 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-89075a76-4953-45ee-946c-1d09fb8975f4 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa90f820>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:44.298535 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-89075a76-4953-45ee-946c-1d09fb8975f4 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.128407 Jun 16 16:40:44.303232 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 13/25] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:44 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:44.690934 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8c234a03-8288-4c64-92af-8d7314195a09 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa90f430>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:44.757948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8c234a03-8288-4c64-92af-8d7314195a09 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.088498 Jun 16 16:40:44.758910 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 14/26] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:44 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:40:45.094602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1435311659", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "networks": [{"uuid": "c9ee3dda-0f7b-420d-947d-a481d1163fa1"}]}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:45.258986 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2593aad1-4386-42c1-9155-36f3eac1d59f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'create', calling method: .version_select at 0x7fe5fa926670>, body: {"keypair": {"name": "tempest-keypair-987447955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSfMYyc4PLNUkXdO18u5fTGTiUNAJc9LKwHHgvPdZ5efW3Ea0hLnyH+fCnNhuL0K23fJTGh4v+mzUQfpmOWoJIsjLkHGFfwbKQcPD6GdtsLY6NZtPTS4l90mlFH9IvdaQ=="}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:45.274531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] validate_networks() for [('c9ee3dda-0f7b-420d-947d-a481d1163fa1', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:40:45.354418 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-2593aad1-4386-42c1-9155-36f3eac1d59f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for project 627133a3363742fda58273b067fab968. Resources: {'key_pairs'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:40:45.377530 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-2593aad1-4386-42c1-9155-36f3eac1d59f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for user 80113e82c4a74f4e8fd42b88aca3920d and project 627133a3363742fda58273b067fab968. Resources: {'key_pairs'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:40:45.502190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2593aad1-4386-42c1-9155-36f3eac1d59f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.463264 Jun 16 16:40:45.504485 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 15/27] 10.222.0.74 () {62 vars in 1199 bytes} [Thu Jun 16 16:40:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 469 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 16 16:40:45.516861 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-da101cfe-0c99-4776-b088-4374a7b243eb tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa884ca0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:45.649553 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-da101cfe-0c99-4776-b088-4374a7b243eb tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.143760 Jun 16 16:40:45.654582 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 16/28] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:45 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:45.770727 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d126359c-9330-4f22-8d0b-dd6fefc633e8 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa884dc0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:45.843328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d126359c-9330-4f22-8d0b-dd6fefc633e8 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 288 microversion: 2.1 time: 0.077199 Jun 16 16:40:45.849157 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 17/29] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:45 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 288 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:45.865756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d060073f-4d04-4e05-89b0-f034098f9d1c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa8843a0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:46.052663 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d060073f-4d04-4e05-89b0-f034098f9d1c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "DELETE /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 202 len: 0 microversion: 2.1 time: 0.202020 Jun 16 16:40:46.053878 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 18/30] 10.222.0.74 () {58 vars in 1253 bytes} [Thu Jun 16 16:40:45 2022] DELETE /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:40:46.062138 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-04e729fa-141a-4da7-a8c5-a84778ec147f tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5fa03b670>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:46.118316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-04e729fa-141a-4da7-a8c5-a84778ec147f tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.060115 Jun 16 16:40:46.119257 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 19/31] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:46 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:40:46.662764 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e2cc12ff-0d30-43eb-b5da-61b156590944 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5fa884280>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:46.780797 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e2cc12ff-0d30-43eb-b5da-61b156590944 tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.122775 Jun 16 16:40:46.781666 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 20/32] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:46 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:40:46.834572 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-587490658", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e1f0da2-a24e-4041-9def-f84f18fbaf90"}], "security_groups": [{"name": "tempest-securitygroup--693237180"}], "key_name": "tempest-keypair-1045044092", "user_data": "}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:47.195298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:40:47.195786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:40:47.196762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:40:47.197231 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:40:47.197647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:40:47.217468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:47.217913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:47.218702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:47.219153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:47.273724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.network.neutron [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] validate_networks() for [('9e1f0da2-a24e-4041-9def-f84f18fbaf90', None, None, None, None, None)] {{(pid=124103) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:40:47.304515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Getting quotas for project 0a7a93f8b61c48759abc98e8b86ad4e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:40:47.314617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Getting quotas for user 5ab5b939a13e43469b3a4a48da559c83 and project 0a7a93f8b61c48759abc98e8b86ad4e8. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:40:47.352515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:40:47.355433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:40:47.497441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-908b6e56-6f58-47bc-bbc7-2e0e04c2625c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.964303 Jun 16 16:40:47.503961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 13/33] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:40:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:40:47.519397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6e4d2d25-67f9-4f95-9863-e1226ef85b9e tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f9fda790>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:47.587184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6e4d2d25-67f9-4f95-9863-e1226ef85b9e tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.081580 Jun 16 16:40:47.591899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 14/34] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:47 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:47.598881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1eaf3e4f-b10e-4953-880b-cd8ed0aae67c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:47.599846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1eaf3e4f-b10e-4953-880b-cd8ed0aae67c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:47.886027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1eaf3e4f-b10e-4953-880b-cd8ed0aae67c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:47.929509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1eaf3e4f-b10e-4953-880b-cd8ed0aae67c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1215 microversion: 2.1 time: 0.336407 Jun 16 16:40:47.930810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 15/35] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:47 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1215 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:47.946096 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2916cf61-e74c-47f1-b3d9-cf5b5d1c0d8c tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5f9fda940>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:48.064144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2916cf61-e74c-47f1-b3d9-cf5b5d1c0d8c tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.124682 Jun 16 16:40:48.064591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 16/36] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:47 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:48.599498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-128a3608-eec1-47b9-9064-e2b9ebec639c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f9ff1280>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:48.689433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-128a3608-eec1-47b9-9064-e2b9ebec639c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.094260 Jun 16 16:40:48.690127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 17/37] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:48 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:48.946514 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4224b3ab-0c1a-4e88-878c-2bc69dd8b742 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:48.947337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4224b3ab-0c1a-4e88-878c-2bc69dd8b742 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:49.419587 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:40:49.420276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:40:49.421425 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:40:49.421944 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:40:49.422527 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:40:49.455172 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:49.458263 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:49.459483 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:49.466862 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:49.526317 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:40:49.539667 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:40:49.569143 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Going to run 1 instances... {{(pid=124103) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:40:49.573688 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:40:49.605892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4224b3ab-0c1a-4e88-878c-2bc69dd8b742 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:49.623405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4224b3ab-0c1a-4e88-878c-2bc69dd8b742 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1215 microversion: 2.1 time: 0.680533 Jun 16 16:40:49.628963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 18/38] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:48 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1215 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:40:49.649657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3a667550-7f2d-4b79-97bb-c74e89633e7c tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5f8f979d0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:49.773450 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-992a40d2-b295-4f27-88d5-bfe99d948362 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.946691 Jun 16 16:40:49.774658 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 21/39] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:40:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 2948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:40:49.783881 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f9c5621f-cdd7-40ed-be2b-f56523c3d6f0 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f9fd5c10>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:49.791298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3a667550-7f2d-4b79-97bb-c74e89633e7c tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 200 len: 353 microversion: 2.1 time: 0.159278 Jun 16 16:40:49.792194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 19/40] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:49 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:49.798079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-facf3990-b3b0-4048-9895-88c613d59d31 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:49.807820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-facf3990-b3b0-4048-9895-88c613d59d31 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:49.894226 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f9c5621f-cdd7-40ed-be2b-f56523c3d6f0 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 200 len: 287 microversion: 2.1 time: 0.118108 Jun 16 16:40:49.895174 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 22/41] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:49 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:49.932515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-facf3990-b3b0-4048-9895-88c613d59d31 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:49.944258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-facf3990-b3b0-4048-9895-88c613d59d31 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1241 microversion: 2.1 time: 0.150727 Jun 16 16:40:49.945266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 20/42] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:49 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1241 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:50.647492 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:50.649035 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:50.678793 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:50.679664 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:50.680732 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:50.681334 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:50.806742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fb35eea4-d90b-4c5d-908e-5e6851c2066b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Calling method '.version_select at 0x7fe5f8f8bee0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:50.897652 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-fb35eea4-d90b-4c5d-908e-5e6851c2066b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] HTTP exception thrown: Volume 2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 could not be found. Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fb35eea4-d90b-4c5d-908e-5e6851c2066b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Request method failure captured: Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 HTTP/1.1 Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq1z_6uQBLv960FPtTR6g6QBU167OQRiad6E95WaX8k5udCLtw_5bxfGTeUG9BTB8LiVfMNiN08fvxu80iRIkwV6uiwY5a71A_xGe2q9wAfS_Hct0dbuxCc9tkfZ0Qa-_-G0AcbDzipzUkVWE7G-giVHu_Kl1Vhuv7aAFdmqfyJLjyYs Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: e136d4cbac6e44a59aebfc722a03b7e6 Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesGetTestJSON-1963863473 Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:40:50.901996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e136d4cbac6e44a59aebfc722a03b7e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/e136d4cbac6e44a59aebfc722a03b7e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/e136d4cbac6e44a59aebfc722a03b7e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_e136d4cbac6e44a59aebfc722a03b7e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesGetTestJSON-1963863473 Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: e136d4cbac6e44a59aebfc722a03b7e6 Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesGetTestJSON-1963863473 Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesGetTestJSON-1963863473-project Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d9d03b65829f4e1d8e497c6c30ccfcdf Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesGetTestJSON-1963863473-project Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Volume 2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 could not be found. Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5'} Jun 16 16:40:50.903258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 could not be found. (HTTP 404) (Request-ID: req-d98f8c96-7f23-4968-8061-4b046ebce0d7) Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:50.904034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:40:50.905255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 could not be found. Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:40:50.911752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 could not be found. Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 could not be found. Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fb35eea4-d90b-4c5d-908e-5e6851c2066b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] Returning 404 to user: Volume 2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fb35eea4-d90b-4c5d-908e-5e6851c2066b tempest-VolumesGetTestJSON-1963863473 tempest-VolumesGetTestJSON-1963863473-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5" status: 404 len: 109 microversion: 2.1 time: 0.101596 Jun 16 16:40:50.912747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 21/43] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:50 2022] GET /compute/v2.1/os-volumes/2b79cc9a-8a14-4c00-8607-f4d4f71d7ca5 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:40:50.934666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2e9d0d67-0e86-41c0-a101-38b0dfeba8f0 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8f97700>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:51.103679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-2e9d0d67-0e86-41c0-a101-38b0dfeba8f0 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] HTTP exception thrown: Snapshot 5bff6162-2913-4033-945a-995efbe49dfa could not be found. Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2e9d0d67-0e86-41c0-a101-38b0dfeba8f0 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Request method failure captured: Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa HTTP/1.1 Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq1z_oXNIN9hchcIcj1mbirjBigxy6nRC5u0mllvBKO9YkW82K2bYd1YtAAMxZJjXgVVnuHRqoG-bFQ3C-cNNIGzGniRg8B_CwXctlxAkavXr6cdaKJnmc-fUxNsYcq-xnW61Y9s9r8F6RROAQjbpmvkBJ6mIxTX3mFFwbpEy9xKICMA Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 28061579532249b7922ab14c12529580 Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:40:51.106457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/28061579532249b7922ab14c12529580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_28061579532249b7922ab14c12529580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 28061579532249b7922ab14c12529580 Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 556cbb2920b448dc81bc90606cfc59f4 Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Snapshot 5bff6162-2913-4033-945a-995efbe49dfa could not be found. Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '5bff6162-2913-4033-945a-995efbe49dfa'} Jun 16 16:40:51.107564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5bff6162-2913-4033-945a-995efbe49dfa could not be found. (HTTP 404) (Request-ID: req-16def914-945e-44a5-80a8-19bc916cc39c) Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:51.108319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:40:51.109361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5bff6162-2913-4033-945a-995efbe49dfa could not be found. Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 16 16:40:51.110605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5bff6162-2913-4033-945a-995efbe49dfa could not be found. Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5bff6162-2913-4033-945a-995efbe49dfa could not be found. Jun 16 16:40:51.113434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:51.114963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2e9d0d67-0e86-41c0-a101-38b0dfeba8f0 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Returning 404 to user: Snapshot 5bff6162-2913-4033-945a-995efbe49dfa could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:40:51.115973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2e9d0d67-0e86-41c0-a101-38b0dfeba8f0 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa" status: 404 len: 111 microversion: 2.1 time: 0.201708 Jun 16 16:40:51.116838 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 22/44] 10.222.0.74 () {58 vars in 1250 bytes} [Thu Jun 16 16:40:50 2022] GET /compute/v2.1/os-snapshots/5bff6162-2913-4033-945a-995efbe49dfa => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:40:51.126919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c8f4dd43-153b-4efb-8dfe-ad453381cc97 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:51.135669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c8f4dd43-153b-4efb-8dfe-ad453381cc97 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:51.204684 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:51.261845 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-816b6144-877d-4da9-9562-52a3f0c7d9c8 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1267 microversion: 2.1 time: 0.619601 Jun 16 16:40:51.262467 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 23/45] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:50 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1267 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:51.283246 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9231d9df-64e9-427c-828c-c5f1cdb260b6 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8f10550>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:51.369641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c8f4dd43-153b-4efb-8dfe-ad453381cc97 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:51.385635 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c8f4dd43-153b-4efb-8dfe-ad453381cc97 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1241 microversion: 2.1 time: 0.265818 Jun 16 16:40:51.387760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 23/46] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:51 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1241 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:51.725640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1490583501", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9928c0d7-4188-44f9-85a5-0c6e9b826316"}], "security_groups": [{"name": "tempest-securitygroup--277138886"}], "key_name": "tempest-keypair-987447955", "user_data": "}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:40:51.823373 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9231d9df-64e9-427c-828c-c5f1cdb260b6 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 202 len: 0 microversion: 2.1 time: 0.553997 Jun 16 16:40:51.823951 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 24/47] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:40:51 2022] DELETE /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:40:51.833477 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-15ed1df0-edf8-4ecd-9c27-ae7e0759a495 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8f1fd30>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:52.067188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-15ed1df0-edf8-4ecd-9c27-ae7e0759a495 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.237917 Jun 16 16:40:52.068347 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 25/48] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:51 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:52.279732 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:52.280451 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:52.289090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:52.295518 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:52.296508 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:52.297032 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:52.450440 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:52.465142 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2f2f2560-72b9-4bd7-ab9b-4076b9f19b0b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1273 microversion: 2.1 time: 0.189682 Jun 16 16:40:52.466138 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 26/49] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:52 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1273 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:40:52.471221 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:52.475871 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:52.518522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:52.519013 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:52.522256 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:52.522621 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:52.537253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] validate_networks() for [('9928c0d7-4188-44f9-85a5-0c6e9b826316', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:40:52.712098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:52.722655 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1b5359cb-e527-48c3-bc71-56d92efd9a89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.254870 Jun 16 16:40:52.723303 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 27/50] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:52 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:53.080898 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-22bb66c3-5336-4530-93d1-f772ba07ba56 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8ecaca0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:53.172554 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-22bb66c3-5336-4530-93d1-f772ba07ba56 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.095431 Jun 16 16:40:53.179513 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 28/51] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:53 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:53.492428 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:53.496517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:53.505813 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:53.506435 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:53.507424 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:53.508423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:53.724669 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:53.734549 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fa97ba61-67af-4403-839a-7377b761ce15 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.255575 Jun 16 16:40:53.744607 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 29/52] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:53 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:40:53.747470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:40:53.748596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:40:53.749233 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:40:53.749650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:40:53.750348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:40:53.752720 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:53.753657 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:53.760810 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:53.761376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:53.761734 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:53.763027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:53.763670 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:53.764132 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:53.764539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:53.764792 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:53.790069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for project 627133a3363742fda58273b067fab968. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:40:53.795868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for user 80113e82c4a74f4e8fd42b88aca3920d and project 627133a3363742fda58273b067fab968. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:40:53.820115 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:40:53.824051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:40:53.837717 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:53.847590 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0677ac8c-53a8-412f-bdb0-63834b4b51ec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.100800 Jun 16 16:40:53.848859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 30/53] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:53 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:53.896184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eb83666d-d65f-4e0b-b2f8-943c8d7f1998 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.175019 Jun 16 16:40:53.902274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 24/54] 10.222.0.74 () {62 vars in 1187 bytes} [Thu Jun 16 16:40:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 16:40:53.908276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e8c2d50e-0de5-42d6-be5c-2e3b18e556a8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:53.908919 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e8c2d50e-0de5-42d6-be5c-2e3b18e556a8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:53.980332 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e8c2d50e-0de5-42d6-be5c-2e3b18e556a8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:53.998499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e8c2d50e-0de5-42d6-be5c-2e3b18e556a8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:54.000139 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e8c2d50e-0de5-42d6-be5c-2e3b18e556a8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:54.001368 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e8c2d50e-0de5-42d6-be5c-2e3b18e556a8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1281 microversion: 2.20 time: 0.097168 Jun 16 16:40:54.002163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 31/55] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:40:53 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1281 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:40:54.187433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-44ad850f-085d-4646-8d9e-22836ca4b66a tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8ef89d0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:54.253565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-44ad850f-085d-4646-8d9e-22836ca4b66a tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.071151 Jun 16 16:40:54.254608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 25/56] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:54 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:54.752238 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:54.752829 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:54.759581 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:54.760022 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:54.760767 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:54.761192 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:54.864545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:54.865233 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:54.872038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:54.872565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:54.873384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:54.873866 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:54.910510 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:54.918084 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cd5a53d1-4767-4845-8eaa-21776be678c4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.169867 Jun 16 16:40:54.919015 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 32/57] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:54 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:55.026768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:55.027557 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:55.041055 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:55.041521 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:55.042365 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:55.042704 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:55.049080 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:55.070659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1cee5c0e-ffd8-425a-b990-72b61d36b2b1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.209821 Jun 16 16:40:55.071880 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 26/58] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:54 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:40:55.147417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:55.156265 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:55.158313 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:55.159578 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1c04e89c-c231-41f5-bb4d-1082af1b87e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.137049 Jun 16 16:40:55.160177 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 33/59] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:40:55 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:40:55.266152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6c1a262e-7757-44dc-8454-059582335b95 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f9fdab80>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:55.317662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6c1a262e-7757-44dc-8454-059582335b95 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.055538 Jun 16 16:40:55.318352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 27/60] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:55 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:55.935567 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:55.936167 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:55.942629 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:55.943112 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:55.944007 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:55.944437 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:56.079976 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:56.088140 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-934ee8ad-4c13-407c-8013-93eb2b90f854 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.156403 Jun 16 16:40:56.088292 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:56.088862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:56.095754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:56.096095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:56.096856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:56.097283 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:56.098078 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 34/61] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:55 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:56.160093 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:56.167763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9c18a47b-7d1f-4356-96bf-ee47d313b3c0 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.083231 Jun 16 16:40:56.168401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 28/62] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:56 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:40:56.180927 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:56.182724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:56.189493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:56.190017 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:56.190844 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:56.191365 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:56.263297 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:56.274196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:56.275957 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:56.277097 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-62bc15bf-663b-4856-9991-181b2069d274 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.100404 Jun 16 16:40:56.277887 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 35/63] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:40:56 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:40:56.330949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-52053340-30c8-4abc-9f3c-8ef59f361c1f tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8ea7f70>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:56.378871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-52053340-30c8-4abc-9f3c-8ef59f361c1f tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.052344 Jun 16 16:40:56.379819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 29/64] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:56 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:57.105389 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:57.105965 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:57.112649 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:57.113090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:57.113839 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:57.114263 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:57.184908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:57.185511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:57.192190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:57.192624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:57.193377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:57.193798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:57.249571 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:57.257545 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-bf6556e2-7dda-4794-807a-ec7d86fee370 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.156035 Jun 16 16:40:57.258119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 36/65] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:57 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:57.258516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:57.266807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c72ba2c4-0440-45d7-bd47-3b19e1b90fb4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.085832 Jun 16 16:40:57.267421 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 30/66] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:57 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:40:57.295759 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:57.296366 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:57.302976 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:57.303392 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:57.304159 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:57.304588 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:57.372387 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:57.383188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:57.384738 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:57.385988 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ab7e82ef-6e6d-41ff-afe8-5f17d09c4030 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.094534 Jun 16 16:40:57.386530 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 37/67] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:40:57 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:40:57.393430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-685e7940-5d31-4cee-8a1d-95677dab6753 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8ea7ca0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:57.441485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-685e7940-5d31-4cee-8a1d-95677dab6753 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.052461 Jun 16 16:40:57.442134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 31/68] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:57 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:58.275130 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:58.275875 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:58.282598 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:58.283036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:58.283686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:58.284196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:58.284275 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:58.284341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:58.297752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:58.298175 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:58.298969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:58.299515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:58.366808 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:58.374698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e56a7e1e-dda2-4725-9aa8-536c58bcfe9d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.095176 Jun 16 16:40:58.375339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 32/69] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:58 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:58.405480 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:58.406404 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:58.413482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:58.414270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:58.415753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:58.419593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:58.444550 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:58.457453 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c18aea77-4d85-45fa-8026-f97960236322 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.186174 Jun 16 16:40:58.458032 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 38/70] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:58 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:58.462859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-59e080c3-8b54-498d-a1b4-791b9f567d2c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8ebb940>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:58.497872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:58.508449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:58.510671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:58.511820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-13347cf2-4ac4-4ae8-b43c-fe254fa6c879 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.110647 Jun 16 16:40:58.512484 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 33/71] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:40:58 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:40:58.519192 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-59e080c3-8b54-498d-a1b4-791b9f567d2c tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 200 len: 345 microversion: 2.1 time: 0.059900 Jun 16 16:40:58.523100 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 39/72] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:58 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:59.395316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:59.396190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:59.410119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:59.410840 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:59.413613 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:59.417409 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:59.484602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:59.485586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:59.502243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:40:59.502976 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:59.504170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:59.506077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:59.506934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:59.539568 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:59.548971 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3d6e34e2-42ef-4e8d-b0b4-6a6a8bd57254 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.159990 Jun 16 16:40:59.556002 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 40/73] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:59 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:59.571499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:59.572531 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:40:59.584594 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:59.585126 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:59.585865 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:40:59.586271 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:40:59.712850 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:59.726520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:59.737801 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:59.739328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4988e09f-668b-4d43-8a3a-241f43ab6563 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.266094 Jun 16 16:40:59.740361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 34/74] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:40:59 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:40:59.744002 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:40:59.748236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-175927d3-471f-4778-a620-261495dbb961 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8e4bf70>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:59.750361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-45702504-71e2-4448-9849-3ccbf3ab862b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.192970 Jun 16 16:40:59.751302 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 41/75] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:40:59 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:40:59.788114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-13fedfc0-19e0-4b02-a0e4-e4df723c87be tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8ef0310>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:59.881485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-175927d3-471f-4778-a620-261495dbb961 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] HTTP exception thrown: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-175927d3-471f-4778-a620-261495dbb961 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Request method failure captured: Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 HTTP/1.1 Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq1z_oXNIN9hchcIcj1mbirjBigxy6nRC5u0mllvBKO9YkW82K2bYd1YtAAMxZJjXgVVnuHRqoG-bFQ3C-cNNIGzGniRg8B_CwXctlxAkavXr6cdaKJnmc-fUxNsYcq-xnW61Y9s9r8F6RROAQjbpmvkBJ6mIxTX3mFFwbpEy9xKICMA Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 28061579532249b7922ab14c12529580 Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:40:59.883486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/28061579532249b7922ab14c12529580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_28061579532249b7922ab14c12529580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 28061579532249b7922ab14c12529580 Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 556cbb2920b448dc81bc90606cfc59f4 Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '7c8c8cc3-79b1-49bd-995b-ca481953a296'} Jun 16 16:40:59.884658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. (HTTP 404) (Request-ID: req-4693bde1-8a47-47cb-a199-cb37eb2f0283) Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:59.885522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:40:59.886791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:40:59.888170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-175927d3-471f-4778-a620-261495dbb961 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Returning 404 to user: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-175927d3-471f-4778-a620-261495dbb961 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 404 len: 109 microversion: 2.1 time: 0.145689 Jun 16 16:40:59.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 35/76] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:59 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:40:59.913261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-16daf7d6-cb75-4e04-9254-5a1b5534fb6b tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8eb09d0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:40:59.968444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-16daf7d6-cb75-4e04-9254-5a1b5534fb6b tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] HTTP exception thrown: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.969037 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-13fedfc0-19e0-4b02-a0e4-e4df723c87be tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/54995f16-6acd-4020-944e-5dbf66ebd399" status: 200 len: 350 microversion: 2.1 time: 0.184852 Jun 16 16:40:59.970168 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 42/77] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:59 2022] GET /compute/v2.1/os-volumes/54995f16-6acd-4020-944e-5dbf66ebd399 => generated 350 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-16daf7d6-cb75-4e04-9254-5a1b5534fb6b tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Request method failure captured: Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 HTTP/1.1 Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq1z_oXNIN9hchcIcj1mbirjBigxy6nRC5u0mllvBKO9YkW82K2bYd1YtAAMxZJjXgVVnuHRqoG-bFQ3C-cNNIGzGniRg8B_CwXctlxAkavXr6cdaKJnmc-fUxNsYcq-xnW61Y9s9r8F6RROAQjbpmvkBJ6mIxTX3mFFwbpEy9xKICMA Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 28061579532249b7922ab14c12529580 Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:40:59.973796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/28061579532249b7922ab14c12529580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_28061579532249b7922ab14c12529580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 28061579532249b7922ab14c12529580 Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 556cbb2920b448dc81bc90606cfc59f4 Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '7c8c8cc3-79b1-49bd-995b-ca481953a296'} Jun 16 16:40:59.974906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. (HTTP 404) (Request-ID: req-408b916d-fbce-4a17-951d-0549af7b6cb0) Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:59.975593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:40:59.976553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:40:59.977501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-16daf7d6-cb75-4e04-9254-5a1b5534fb6b tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Returning 404 to user: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:40:59.978431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-16daf7d6-cb75-4e04-9254-5a1b5534fb6b tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 404 len: 109 microversion: 2.1 time: 0.074593 Jun 16 16:40:59.985070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 36/78] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:40:59 2022] DELETE /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:40:59.993582 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1d04abdf-764a-436c-8288-94c296677b03 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Calling method '.version_select at 0x7fe5f8ed1d30>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:00.062062 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-1d04abdf-764a-436c-8288-94c296677b03 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] HTTP exception thrown: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1d04abdf-764a-436c-8288-94c296677b03 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Request method failure captured: Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: request: GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 HTTP/1.1 Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept: application/json Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept-Encoding: identity Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Connection: close Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Length: 0 Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Type: application/json Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Host: 10.222.0.74 Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Openstack-System-Scope: None Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: User-Agent: python-urllib3/1.26.9 Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Auth-Token: gAAAAABiq1z_oXNIN9hchcIcj1mbirjBigxy6nRC5u0mllvBKO9YkW82K2bYd1YtAAMxZJjXgVVnuHRqoG-bFQ3C-cNNIGzGniRg8B_CwXctlxAkavXr6cdaKJnmc-fUxNsYcq-xnW61Y9s9r8F6RROAQjbpmvkBJ6mIxTX3mFFwbpEy9xKICMA Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Id: None Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Name: None Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Identity-Status: Confirmed Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Is-Admin-Project: True Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Id: default Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Name: Default Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Id: 28061579532249b7922ab14c12529580 Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Role: reader,member Jun 16 16:41:00.069000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Roles: reader,member Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/28061579532249b7922ab14c12529580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/28061579532249b7922ab14c12529580"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_28061579532249b7922ab14c12529580"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Id: 28061579532249b7922ab14c12529580 Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1041429139 Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Id: default Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Name: Default Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Id: 556cbb2920b448dc81bc90606cfc59f4 Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1041429139-project Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: method: Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: exception: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: action_args: {'id': '7c8c8cc3-79b1-49bd-995b-ca481953a296'} Jun 16 16:41:00.070243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. (HTTP 404) (Request-ID: req-5f55901c-c34d-4bb8-a514-2810366f185b) Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:41:00.071074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:41:00.072033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:41:00.073005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. Jun 16 16:41:00.073913 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:41:00.084361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1d04abdf-764a-436c-8288-94c296677b03 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] Returning 404 to user: Volume 7c8c8cc3-79b1-49bd-995b-ca481953a296 could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:41:00.086694 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1d04abdf-764a-436c-8288-94c296677b03 tempest-VolumesSnapshotsTestJSON-1041429139 tempest-VolumesSnapshotsTestJSON-1041429139-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296" status: 404 len: 109 microversion: 2.1 time: 0.106779 Jun 16 16:41:00.094415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 43/79] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:40:59 2022] GET /compute/v2.1/os-volumes/7c8c8cc3-79b1-49bd-995b-ca481953a296 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:41:00.573997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:00.575433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:00.584698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:00.585207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:00.586020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:00.586452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:00.684100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:00.699092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-db0074e4-342c-4086-943d-d639aa81e9c6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.129452 Jun 16 16:41:00.700088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 37/80] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:00 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:00.764862 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:00.766232 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:00.770506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:00.771452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:00.773324 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:00.773838 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:00.774977 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:00.775632 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:00.777875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:00.778328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:00.779139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:00.779689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:00.901090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:00.911804 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:00.913803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:00.915282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-54971639-df5d-4dd2-b5bb-ede9d94b855d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.149565 Jun 16 16:41:00.927272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 38/81] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:00 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:41:01.051586 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:01.071268 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-853c628b-f9c4-4ee9-878f-22ace1c74afe tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.308750 Jun 16 16:41:01.072244 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 44/82] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:00 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:01.718721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:01.719320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:01.725978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:01.726925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:01.728027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:01.728594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:01.795326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:01.805703 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d3ea3c9b-74f3-4d8e-a6a2-b035a23e4f98 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.092822 Jun 16 16:41:01.806442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 39/83] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:01 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:01.933975 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:01.934720 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:01.942575 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:01.943448 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:01.944440 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:01.945014 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:02.024265 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:02.037493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:02.039375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:02.040492 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-03815c58-af1f-45e5-bc12-5a0756052c2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.110857 Jun 16 16:41:02.041042 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 45/84] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:01 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:02.089061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:02.089663 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:02.095874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:02.096745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:02.097073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:02.097502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:02.286992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:02.299289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dfb2ff5b-f196-4f1a-943a-de25bb11d937 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.210779 Jun 16 16:41:02.299289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 40/85] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:02 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:02.572173 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c59364dc-d670-4e9b-9f69-0ab50e167e2b tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8e3d9d0>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:02.631267 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c59364dc-d670-4e9b-9f69-0ab50e167e2b tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/fe1c7895-8df0-40df-b553-042c21a8dd71" status: 200 len: 351 microversion: 2.1 time: 0.063622 Jun 16 16:41:02.631868 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 46/86] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:41:02 2022] GET /compute/v2.1/os-volumes/fe1c7895-8df0-40df-b553-042c21a8dd71 => generated 351 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:02.825933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:02.826720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:02.834720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:02.836195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:02.837306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:02.837741 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:02.921056 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:02.932299 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-913e51c3-019a-4048-b050-89d51b06b321 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.112858 Jun 16 16:41:02.935152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 41/87] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:02 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:03.060153 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:03.061751 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:03.074333 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:03.082543 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:03.083745 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:03.084221 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:03.094912 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:03.180592 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:03.195208 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:03.197589 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:03.198954 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1295816c-0b35-4749-9586-74fca758c415 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.144364 Jun 16 16:41:03.199763 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 47/88] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:03 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:03.316079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:03.316767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:03.323525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:03.323899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:03.324964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:03.325525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:03.553522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:03.565476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6e13391b-6e5c-4d5b-bf17-22d26748a944 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.255793 Jun 16 16:41:03.575668 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 42/89] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:03 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:03.950122 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:03.951262 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:03.962759 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:03.963547 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:03.964368 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:03.965012 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:03.995802 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=12 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:04.032569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:04.047221 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b59945d3-5e3e-4cf4-9e68-c0d36fbad88c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.099041 Jun 16 16:41:04.049508 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 48/90] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:03 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:04.215972 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:04.216734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=24 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:04.221015 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:04.221624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:04.229119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:04.229792 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:04.230710 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:04.231455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:04.320732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:04.345263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:04.347349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:04.349650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-30317b52-d438-49a1-87a5-3a2c34f247c4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.134196 Jun 16 16:41:04.350655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 43/91] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:04 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:04.582236 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:04.582845 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:04.597460 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:04.598299 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:04.599191 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:04.599679 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:04.833259 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:04.858062 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4e20751a-2136-4397-8716-1a519c4e6103 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.279566 Jun 16 16:41:04.863141 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 49/92] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:04 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:05.066867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.067503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:05.077682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:05.078130 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:05.082952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:05.083412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:05.161052 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4ad064a8-d683-4208-97ae-49b453c13d9b tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8e3d550>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.184774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:05.197502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ebe4671a-aacd-4b70-a76f-719c6c2e24db tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.135470 Jun 16 16:41:05.198193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 44/93] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:05.246216 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4ad064a8-d683-4208-97ae-49b453c13d9b tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/42cffb35-16d1-4a4c-9d80-37a582fe5e79" status: 200 len: 349 microversion: 2.1 time: 0.089688 Jun 16 16:41:05.253933 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 50/94] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes/42cffb35-16d1-4a4c-9d80-37a582fe5e79 => generated 349 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:41:05.259515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0ade4f15-b502-42c6-aec0-a1ccca568767 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8e3f940>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.354956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0ade4f15-b502-42c6-aec0-a1ccca568767 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.099400 Jun 16 16:41:05.355993 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 45/95] 10.222.0.74 () {58 vars in 1133 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:05.368846 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-89432d48-897e-40a1-8ac4-020d6130bd2e tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8ef0940>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.370231 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.370948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:05.378736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:05.379921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:05.380859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:05.381348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:05.469816 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-89432d48-897e-40a1-8ac4-020d6130bd2e tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.105324 Jun 16 16:41:05.470397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 51/96] 10.222.0.74 () {58 vars in 1148 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:41:05.482407 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-a266c194-3f13-4665-849e-44539e220545 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8eca160>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.491083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:05.500690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:05.502259 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:05.503521 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-50e670c7-389e-4af6-8ddf-90261f06bf17 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.137883 Jun 16 16:41:05.505136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 46/97] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:41:05.581440 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-a266c194-3f13-4665-849e-44539e220545 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.102946 Jun 16 16:41:05.582254 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 52/98] 10.222.0.74 () {58 vars in 1133 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:05.593391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-97e8833c-c443-4984-8114-2b294d2cab37 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8ea7b80>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.680907 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-97e8833c-c443-4984-8114-2b294d2cab37 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091352 Jun 16 16:41:05.681534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 47/99] 10.222.0.74 () {58 vars in 1166 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:05.693195 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2ff69239-1cd7-4dfd-8ef7-fd8b3a25e1cb tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8ef0f70>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.777595 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2ff69239-1cd7-4dfd-8ef7-fd8b3a25e1cb tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.088188 Jun 16 16:41:05.778647 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 53/100] 10.222.0.74 () {58 vars in 1169 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:05.792595 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c5e33f5c-a106-4855-b5ac-d7214ccadbd8 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8eb0f70>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.876912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c5e33f5c-a106-4855-b5ac-d7214ccadbd8 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.088324 Jun 16 16:41:05.881646 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 48/101] 10.222.0.74 () {58 vars in 1154 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:05.881940 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.881940 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:05.888318 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:05.888768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:05.889541 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:05.889665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d138aa14-deb4-4977-83e4-c5508035d9ca tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8e4b430>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:05.889966 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:05.973833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d138aa14-deb4-4977-83e4-c5508035d9ca tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088744 Jun 16 16:41:05.974399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 49/102] 10.222.0.74 () {58 vars in 1187 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:41:05.987828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3347510e-dbb1-4d01-89ec-e40f7f22f051 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] Calling method '.version_select at 0x7fe5f8ea10d0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:06.059824 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:06.069493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-dfa83c98-cf30-4d60-8fe5-d1f44e18633b tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.191774 Jun 16 16:41:06.070134 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 54/103] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:06.090478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3347510e-dbb1-4d01-89ec-e40f7f22f051 tempest-VolumesTestJSON-638298744 tempest-VolumesTestJSON-638298744-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.107155 Jun 16 16:41:06.091606 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 50/104] 10.222.0.74 () {58 vars in 1154 bytes} [Thu Jun 16 16:41:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:06.216448 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:06.217088 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:06.229932 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:06.230572 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:06.231843 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:06.232517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:06.298718 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:06.307185 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4d98b16f-eef9-4260-ae2c-5518d5c31105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.095315 Jun 16 16:41:06.307985 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 55/105] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:06 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:06.522913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:06.523601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:06.530252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:06.530835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:06.536951 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:06.537395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:06.642797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:06.647457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:06.654056 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:06.656465 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:06.658037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ebf475bf-150b-43f1-9923-108f01973551 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.139780 Jun 16 16:41:06.659315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 51/106] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:06 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:07.089589 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:07.090974 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:07.098357 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:07.099007 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:07.099983 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:07.100577 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:07.324408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:07.325962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:07.342786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:07.343546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:07.344536 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:07.348517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:07.492279 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:07.505793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-67652bf2-b9de-4eac-aa4d-362caafe443a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.185220 Jun 16 16:41:07.508525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 52/107] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:07 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:07.558626 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:07.568333 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-43c5408e-dd6d-49ae-b03b-3044da94bc3d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.483397 Jun 16 16:41:07.570170 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 56/108] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:07 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:07.677191 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:07.677905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:07.695769 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:07.696157 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:07.703706 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:07.704316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:07.827620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:07.843526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:07.845949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:07.850416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-abf38e8e-bd94-476f-880a-9fbbc9b3db6c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.177247 Jun 16 16:41:07.851167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 53/109] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:07 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:08.528012 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:08.529307 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:08.536325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:08.537231 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:08.538310 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:08.538877 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:08.595037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:08.595037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:08.599613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:08.604791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:08.605334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:08.607206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:08.607717 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:08.687193 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:08.699469 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-08c3501d-82c4-4b55-9e13-8bbfedd90f9c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1293 microversion: 2.1 time: 0.177681 Jun 16 16:41:08.702446 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 57/110] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:08 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:08.869884 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:08.870507 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:08.882662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:08.894846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-217ac053-f1d4-4b15-b5fe-455201139b5a tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.311362 Jun 16 16:41:08.895110 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:08.895325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:08.896375 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 54/111] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:08 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:08.897980 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:08.898424 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:09.040458 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:09.051896 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:09.055899 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:09.061378 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7e197412-bc68-4935-81ba-9811dd0b17be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1285 microversion: 2.20 time: 0.196579 Jun 16 16:41:09.078508 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 58/112] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:08 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:09.719590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:09.720450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:09.735490 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:09.736369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:09.737336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:09.737898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:09.862094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:09.876044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-87fa0576-2e78-4f8f-aa11-1ea816d3be0e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1311 microversion: 2.1 time: 0.161341 Jun 16 16:41:09.883094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 55/113] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:09 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1311 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:09.913082 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:09.914449 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:09.929616 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:09.932386 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:09.934433 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:09.935018 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:10.083728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:10.085085 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:10.098726 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:10.099368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:10.100694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:10.101426 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:10.280328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:10.294317 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:10.296717 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:10.302866 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-180c2184-ac37-4794-8558-2a1407d3234b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1341 microversion: 2.20 time: 0.222609 Jun 16 16:41:10.304217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 56/114] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:10 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1341 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:41:10.371982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:10.382185 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c9111036-fc4b-4ce3-a41f-8fad7a899734 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.473281 Jun 16 16:41:10.382777 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 59/115] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:09 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:10.896351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:10.897114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:10.907834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:10.909089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:10.910601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:10.912333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:11.322701 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:11.323338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:11.340103 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:11.340756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:11.341790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:11.342356 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:11.410732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:11.429655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fa75ae5a-f88f-4d00-8cd8-b8d2660ea273 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.537572 Jun 16 16:41:11.437179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 57/116] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:10 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:11.455201 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:11.455835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:11.470806 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:11.471771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:11.474455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:11.477785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:11.836820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:11.847114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b768bb7c-1927-43ed-bec8-94dae17e67d3 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.408290 Jun 16 16:41:11.847724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 58/117] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:11 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:11.907987 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:11.916950 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:11.927741 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:11.929226 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ebaa0aff-6b8d-4b05-9f20-db121f906f95 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1339 microversion: 2.20 time: 0.610519 Jun 16 16:41:11.930471 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 60/118] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:11 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1339 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:12.368482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-fa8303c0-cd95-46fd-bd69-65af2a2a827f req-eb36a3a1-ccdd-433d-8cd1-22a86be57309 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da37036e-0eba-448b-bffc-2e8601b8165c", "tag": "ae17f4d3-5698-43d8-97e1-dd1f94c90140"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:12.390901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-fa8303c0-cd95-46fd-bd69-65af2a2a827f req-eb36a3a1-ccdd-433d-8cd1-22a86be57309 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:12.392313 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-fa8303c0-cd95-46fd-bd69-65af2a2a827f req-eb36a3a1-ccdd-433d-8cd1-22a86be57309 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:12.434691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-fa8303c0-cd95-46fd-bd69-65af2a2a827f req-eb36a3a1-ccdd-433d-8cd1-22a86be57309 service nova] Creating event network-changed:ae17f4d3-5698-43d8-97e1-dd1f94c90140 for instance da37036e-0eba-448b-bffc-2e8601b8165c on hv-cinder-83735 Jun 16 16:41:12.440712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-fa8303c0-cd95-46fd-bd69-65af2a2a827f req-eb36a3a1-ccdd-433d-8cd1-22a86be57309 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 16:41:12.442229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3c432f3-20a6-4858-98a2-3b452cea1f19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:12.442878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3c432f3-20a6-4858-98a2-3b452cea1f19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:12.445608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3c432f3-20a6-4858-98a2-3b452cea1f19 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:12.446405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3c432f3-20a6-4858-98a2-3b452cea1f19 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:12.453876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:12.454470 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:12.463855 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:12.465655 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:12.468886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:12.469880 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:12.471757 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:12.474186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.compute.rpcapi [None req-c3c432f3-20a6-4858-98a2-3b452cea1f19 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 16:41:12.475428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3c432f3-20a6-4858-98a2-3b452cea1f19 None None] Releasing lock "compute-rpcapi-router" {{(pid=124104) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 16:41:12.509949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c3c432f3-20a6-4858-98a2-3b452cea1f19 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.450443 Jun 16 16:41:12.511883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 59/119] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:12.865970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:12.866688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:12.882539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:12.883309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:12.884228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:12.890785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:13.078681 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:13.088844 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-071ab5c4-ad54-43f0-8509-b1068d5ab1ab tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.640708 Jun 16 16:41:13.092279 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 61/120] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:12 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:13.100470 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:13.103818 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:13.120348 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:13.120908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:13.121806 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:13.122340 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:13.343226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:13.355764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-33d49afb-f15f-4b74-ae0b-44964ea8fafd tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.494702 Jun 16 16:41:13.357000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 60/121] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:12 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:13.439679 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:13.454415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:13.460907 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:13.462517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7a9b1e4d-e2fc-4df8-b8e4-498273603ae3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.368967 Jun 16 16:41:13.476358 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 62/122] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:13 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:13.746390 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-ac5e5251-40c3-45b5-a15e-1afe0674867f req-e85369b9-2f2f-42ad-9cac-3bbb635a5f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54ec605-c392-472a-a282-72b1631a9f92", "tag": "ec2a77a9-ab99-44ef-b4b5-4d131163de17"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:13.759244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-ac5e5251-40c3-45b5-a15e-1afe0674867f req-e85369b9-2f2f-42ad-9cac-3bbb635a5f95 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:13.759995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-ac5e5251-40c3-45b5-a15e-1afe0674867f req-e85369b9-2f2f-42ad-9cac-3bbb635a5f95 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:13.774983 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-ac5e5251-40c3-45b5-a15e-1afe0674867f req-e85369b9-2f2f-42ad-9cac-3bbb635a5f95 service nova] Creating event network-changed:ec2a77a9-ab99-44ef-b4b5-4d131163de17 for instance a54ec605-c392-472a-a282-72b1631a9f92 on hv-cinder-83735 Jun 16 16:41:13.783841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-ac5e5251-40c3-45b5-a15e-1afe0674867f req-e85369b9-2f2f-42ad-9cac-3bbb635a5f95 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275683 Jun 16 16:41:13.785065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 61/123] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:14.109990 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:14.110600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:14.120509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:14.122066 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:14.123013 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:14.125025 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:14.301775 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:14.316375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-80ef27fe-c79e-4967-aacc-fea315e0b556 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.211256 Jun 16 16:41:14.330216 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 63/124] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:14 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:14.374232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:14.375188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:14.383203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:14.383667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:14.384406 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:14.385267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:14.485328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:14.486084 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:14.497499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:14.497944 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:14.500229 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:14.504485 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:14.598474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:14.629613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eab4993d-a8e9-4cf1-95e3-76908660f7da tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.260009 Jun 16 16:41:14.633786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 62/125] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:14 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:14.643578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-308b07b8-39f8-4d7f-b9c7-b2544f497d07 req-4b56c85c-8428-4688-8c2e-01de9e1939e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7f89d4-2837-48f0-854e-4267acb270bb", "tag": "6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:14.666122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-308b07b8-39f8-4d7f-b9c7-b2544f497d07 req-4b56c85c-8428-4688-8c2e-01de9e1939e6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:14.666824 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-308b07b8-39f8-4d7f-b9c7-b2544f497d07 req-4b56c85c-8428-4688-8c2e-01de9e1939e6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:14.689408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-308b07b8-39f8-4d7f-b9c7-b2544f497d07 req-4b56c85c-8428-4688-8c2e-01de9e1939e6 service nova] Creating event network-changed:6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d for instance 0b7f89d4-2837-48f0-854e-4267acb270bb on hv-cinder-83735 Jun 16 16:41:14.697592 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-308b07b8-39f8-4d7f-b9c7-b2544f497d07 req-4b56c85c-8428-4688-8c2e-01de9e1939e6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062464 Jun 16 16:41:14.698619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 63/126] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:14.922461 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:14.932306 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:14.933801 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:14.935864 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fbec9f88-a06f-4eb3-b8cb-f9275472eb23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.456307 Jun 16 16:41:14.937096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 64/127] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:14 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:15.334137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:15.335367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:15.343324 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:15.344000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:15.345030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:15.345739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:15.544832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:15.560075 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ad5c12dd-11ff-4cc5-94ee-5d0a872a1eec tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.229966 Jun 16 16:41:15.561849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 64/128] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:15 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:15.647686 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:15.648422 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:15.655352 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:15.656036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:15.656950 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:15.657522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:15.953574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:15.956028 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:15.956659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:15.969685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:15.970138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:15.972830 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-77a61c25-312a-4fb5-b7d8-1d9d646ee085 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.326793 Jun 16 16:41:15.974841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 65/129] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:15 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:15.989986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:15.989986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:16.265618 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:16.274551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:16.276592 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:16.278230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7df01d85-38d6-4a9a-a5d2-8397635d990a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.326404 Jun 16 16:41:16.279578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 65/130] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:15 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:41:16.578036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:16.578643 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:16.585160 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:16.585594 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:16.586640 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:16.587300 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:16.852405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:16.860981 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6628e7cb-e1d0-4675-9f88-7ce52c12db84 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.286965 Jun 16 16:41:16.870600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 66/131] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:16 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:16.990875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:16.991652 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:16.999451 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:17.000265 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:17.001121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:17.001638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:17.152282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:17.166095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a43ec8d4-20db-4fde-9912-9d6bfdd536de tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.179806 Jun 16 16:41:17.168310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 66/132] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:16 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:17.298870 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:17.299534 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:17.312042 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:17.312692 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:17.313805 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:17.314501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:17.478140 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:17.482510 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:17.490126 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:17.491998 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:17.494367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-144555c5-84d2-4562-86c6-efe0d968a35c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.200219 Jun 16 16:41:17.495519 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 67/133] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:17 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:17.878803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:17.879636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:17.886656 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:17.887267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:17.888043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:17.888463 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:18.036842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:18.045884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-100ba29c-c59a-48a2-ae19-b0b8c5b8735b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.171100 Jun 16 16:41:18.046468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 67/134] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:17 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:18.191021 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:18.191651 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:18.209099 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:18.209547 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:18.210306 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:18.213883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:18.440612 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:18.450292 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7a381f11-874d-4ae4-8ea8-0d4574ca607d tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.266042 Jun 16 16:41:18.451338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 68/135] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:18 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:18.515447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:18.516160 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:18.525837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:18.527733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:18.529289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:18.529798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:18.794381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:18.803947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:18.805440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:18.806942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ff63b532-7eb8-462d-95b5-8cb784823607 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.296961 Jun 16 16:41:18.807537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 68/136] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:18 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:19.063710 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:19.064571 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:19.071475 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:19.071920 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:19.072856 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:19.073281 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:19.232333 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:19.239367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6adb9820-400a-4e96-87d1-00d35a6cf5e4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.180601 Jun 16 16:41:19.249349 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 69/137] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:19 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:19.470451 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:19.471247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:19.477478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:19.478072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:19.478851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:19.479314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:19.649093 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:19.657142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8d42dfcc-0a9e-4369-a8b5-f9aeadc90fdf tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.193459 Jun 16 16:41:19.666837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 69/138] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:19 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:19.825706 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:19.826389 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:19.832811 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:19.833397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:19.834386 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:19.834949 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:19.987185 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:19.996737 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:19.998445 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:20.000245 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-877da223-6b11-4580-8bbe-66e56b77c9ec tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.178746 Jun 16 16:41:20.001362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 70/139] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:19 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:20.257721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:20.258406 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:20.264816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:20.265358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:20.266355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:20.266995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:20.272045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:20.425347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:20.434970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bc40fdaf-a39f-43cc-895e-5791cc83572b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.181555 Jun 16 16:41:20.436174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 70/140] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:20 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:20.674512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:20.675135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:20.681864 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:20.682565 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:20.683538 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:20.684319 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:20.855021 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:20.864155 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b6ac336c-605e-4a18-b982-7c11345b608c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.193525 Jun 16 16:41:20.864764 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 71/141] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:20 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:21.019659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:21.020228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:21.026490 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:21.026929 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:21.027783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:21.028178 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:21.172522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:21.180857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:21.182364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:21.183512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1039fe6d-9b2a-478d-8052-2b412ffc74fb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.167762 Jun 16 16:41:21.184163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 71/142] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:21 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:21.453274 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:21.454028 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:21.460295 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:21.460736 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:21.461492 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:21.461912 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:21.611003 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:21.618997 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7e8882fd-4f51-4c29-a06d-f91767ece9f8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.169857 Jun 16 16:41:21.619604 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 72/143] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:21 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:21.882498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:21.883252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:21.889657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:21.890099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:21.890857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:21.891315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:22.036875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:22.044553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ab97660f-392e-42d3-a6d9-1ceab0739d61 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.166710 Jun 16 16:41:22.045138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 72/144] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:21 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:22.208567 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:22.209307 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:22.217480 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:22.218018 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:22.218952 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:22.219424 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:22.367324 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:22.375966 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:22.377482 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:22.378583 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0d1bf9dd-d933-42ea-9a64-db9d73d75f37 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.175251 Jun 16 16:41:22.379409 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 73/145] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:22 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:22.635776 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:22.636382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:22.638416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:22.644053 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:22.644382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:22.645205 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:22.645557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:22.779583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:22.787034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0316a133-4831-47c1-b9c3-d37b02018a80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.155118 Jun 16 16:41:22.787647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 73/146] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:22 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:23.061286 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:23.062653 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:23.069378 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:23.069865 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:23.070571 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:23.071073 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:23.205805 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:23.215158 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-aa47cd2f-da63-4de8-a1e4-067829cb3c44 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.157823 Jun 16 16:41:23.215816 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 74/147] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:23 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:23.397630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:23.398215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:23.405022 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:23.405484 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:23.406242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:23.406664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:23.549676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:23.560253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:23.561695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:23.562813 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eec4812d-c295-4d7b-92be-30465339bed3 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.169366 Jun 16 16:41:23.563401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 74/148] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:23 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:23.803714 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:23.804344 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:23.811002 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:23.811475 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:23.812255 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:23.812641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:23.967388 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:23.976322 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1d74278a-7d12-4482-adc1-86be4f41fe1b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.176559 Jun 16 16:41:23.976890 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 75/149] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:23 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:24.236005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:24.236881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:24.244992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:24.245509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:24.246694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:24.247372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:24.414544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:24.425730 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ad7908ce-384b-4cdb-b818-9b6d1edc1a5c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.196749 Jun 16 16:41:24.426349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 75/150] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:24 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:24.581795 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:24.583081 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:24.589675 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:24.590108 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:24.590972 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:24.591431 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:24.725600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:24.734455 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:24.735982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:24.737121 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0c91ae9a-24bc-4a0c-af12-abb7e7a0381e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.159697 Jun 16 16:41:24.737677 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 76/151] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:24 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:24.994719 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:24.995418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:25.002532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:25.003023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:25.003963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:25.004382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:25.178285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:25.186854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a330e009-6ac3-45af-86d5-e5da9bd0b891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.196630 Jun 16 16:41:25.187998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 76/152] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:24 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:25.441798 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:25.442499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:25.449064 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:25.449463 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:25.450321 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:25.450747 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:25.592614 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:25.600476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ba043b4e-d573-4eb5-a184-4d2cbf1d6d67 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.162465 Jun 16 16:41:25.603141 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 77/153] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:25 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:25.755868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:25.756838 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:25.763366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:25.763806 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:25.764562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:25.764983 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:25.900695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:25.909273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:25.910764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:25.911895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b06a642e-a36e-43fd-891b-6e7397c718d0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.160605 Jun 16 16:41:25.912491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 77/154] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:25 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:26.205440 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:26.206157 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:26.212422 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:26.213123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:26.213912 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:26.214505 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:26.351666 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:26.359366 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b3e52f73-0ad4-4982-8560-5092499c4ea4 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.158158 Jun 16 16:41:26.360027 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 78/155] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:26 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:26.619782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:26.620863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:26.630527 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:26.631107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:26.632334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:26.632983 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:26.766358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:26.774287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e979832a-a9e8-4c1e-bc5c-4fdac97e592c tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.160224 Jun 16 16:41:26.774894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 78/156] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:26 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:26.930816 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:26.931600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:26.938124 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:26.938979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:26.939834 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:26.940330 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.082509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:27.091397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:27.092892 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:27.094956 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-a3cfc587-7b8c-4efe-9853-f38ed7fb7cdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.168424 Jun 16 16:41:27.095589 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 79/157] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:26 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:27.376519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:27.377105 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:27.384013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:27.384462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.385221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:27.385652 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.556538 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:27.565340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-352389b3-6a2b-4f7a-9a25-80f37c513c27 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.193113 Jun 16 16:41:27.566305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 79/158] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:27 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:27.778233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-ad7c2298-b0d0-4c77-a484-78d5de5b7b04 req-79eda575-d923-4106-8e83-3e6fd0520cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da37036e-0eba-448b-bffc-2e8601b8165c", "name": "network-vif-plugged", "status": "completed", "tag": "ae17f4d3-5698-43d8-97e1-dd1f94c90140"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:27.789698 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-ad7c2298-b0d0-4c77-a484-78d5de5b7b04 req-79eda575-d923-4106-8e83-3e6fd0520cc4 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:27.790131 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-ad7c2298-b0d0-4c77-a484-78d5de5b7b04 req-79eda575-d923-4106-8e83-3e6fd0520cc4 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.791454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:27.792054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:27.798329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:27.798840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.799660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:27.800105 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.810049 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-ad7c2298-b0d0-4c77-a484-78d5de5b7b04 req-79eda575-d923-4106-8e83-3e6fd0520cc4 service nova] Creating event network-vif-plugged:ae17f4d3-5698-43d8-97e1-dd1f94c90140 for instance da37036e-0eba-448b-bffc-2e8601b8165c on hv-cinder-83735 Jun 16 16:41:27.810566 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-ad7c2298-b0d0-4c77-a484-78d5de5b7b04 req-79eda575-d923-4106-8e83-3e6fd0520cc4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 16 16:41:27.811727 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f420702-89ca-4067-86f0-e61fd4956550 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:27.812151 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f420702-89ca-4067-86f0-e61fd4956550 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.812906 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f420702-89ca-4067-86f0-e61fd4956550 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:27.813322 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f420702-89ca-4067-86f0-e61fd4956550 None None] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:27.822507 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.compute.rpcapi [None req-9f420702-89ca-4067-86f0-e61fd4956550 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 16 16:41:27.823382 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f420702-89ca-4067-86f0-e61fd4956550 None None] Releasing lock "compute-rpcapi-router" {{(pid=124103) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 16 16:41:27.838847 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9f420702-89ca-4067-86f0-e61fd4956550 None None] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120641 Jun 16 16:41:27.839446 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 80/159] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:27.944061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:27.952079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bf2fc959-153c-4b5c-95d5-e9a2f6985a32 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.164461 Jun 16 16:41:27.952624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 80/160] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:27 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:28.113672 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:28.114454 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:28.121053 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:28.121484 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:28.122225 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:28.122642 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:28.583100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:28.583737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:28.598041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:28.598509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:28.599340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:28.599766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:28.751403 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:28.768379 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:28.770222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:28.771419 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-de09e54d-1ab2-4ec0-bb94-85a791846821 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.662221 Jun 16 16:41:28.772339 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 81/161] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:28 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:28.974023 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:28.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:28.986408 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:28.986875 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:28.988058 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:28.988488 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:29.241963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:29.260713 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bb29ae16-f7d7-46fd-942d-9c7ad7e1080f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.681622 Jun 16 16:41:29.261350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 81/162] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:28 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:29.546410 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:29.562422 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-30461c71-3fab-498f-aea8-606ad1b329ef tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.592217 Jun 16 16:41:29.567503 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 82/163] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:28 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:29.790227 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:29.790989 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:29.799088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:29.799524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:29.800535 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:29.800999 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:30.033783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:30.046665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:30.057525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:30.058738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-92129193-7cd1-4c8a-8d2e-b9d2d90abf89 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.272795 Jun 16 16:41:30.060045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 82/164] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:29 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:30.278301 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:30.279117 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:30.296876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:30.298305 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:30.298692 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:30.301118 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:30.537074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:30.559341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-001bbaba-6c5b-410f-9b3c-4a92a3b2466c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.285424 Jun 16 16:41:30.560989 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 83/165] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:30 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:30.585510 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:30.586722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:30.594364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:30.594801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:30.595619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:30.596044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:30.863758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:30.872673 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5578b68c-abb6-4a54-9d6c-d2b217fc9606 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.290556 Jun 16 16:41:30.872673 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 83/166] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:30 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:31.078375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:31.079028 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:31.086490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:31.086948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:31.087770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:31.088191 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:31.244444 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:31.248925 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:31.256071 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:31.258109 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:31.259285 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-25beee33-9e66-4890-b8e6-e1e28370af84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.186126 Jun 16 16:41:31.260055 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 84/167] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:31 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:31.582378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:31.583477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:31.595126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:31.597196 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:31.600050 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:31.600752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:31.627731 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-7eb2057d-4576-4eca-9008-64551d6c287e req-99747c0c-ee28-4ff3-a9b4-1998bbabc0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a54ec605-c392-472a-a282-72b1631a9f92", "name": "network-vif-plugged", "status": "completed", "tag": "ec2a77a9-ab99-44ef-b4b5-4d131163de17"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:31.658820 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-7eb2057d-4576-4eca-9008-64551d6c287e req-99747c0c-ee28-4ff3-a9b4-1998bbabc0cf service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:31.662577 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-7eb2057d-4576-4eca-9008-64551d6c287e req-99747c0c-ee28-4ff3-a9b4-1998bbabc0cf service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:31.701372 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-7eb2057d-4576-4eca-9008-64551d6c287e req-99747c0c-ee28-4ff3-a9b4-1998bbabc0cf service nova] Creating event network-vif-plugged:ec2a77a9-ab99-44ef-b4b5-4d131163de17 for instance a54ec605-c392-472a-a282-72b1631a9f92 on hv-cinder-83735 Jun 16 16:41:31.725483 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-7eb2057d-4576-4eca-9008-64551d6c287e req-99747c0c-ee28-4ff3-a9b4-1998bbabc0cf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103963 Jun 16 16:41:31.726962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 85/168] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:41:31.893570 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:31.894493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:31.896182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:31.905388 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-320f37fe-96fa-41f4-b394-d45bc7d1acce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.331803 Jun 16 16:41:31.906197 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 84/169] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:31 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:31.913839 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:31.913839 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:31.914201 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:31.914671 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:32.069749 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:32.081570 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-640f41bc-170d-4600-881e-154293118867 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.194902 Jun 16 16:41:32.082486 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 86/170] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:31 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:32.278547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:32.279467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:32.285841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:32.286537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:32.287517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:32.287938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:32.464803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:32.477453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:32.480532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:32.483247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9e0261f9-b2cc-4ee1-8be1-0fb63f7fcaa4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.209334 Jun 16 16:41:32.484138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 85/171] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:32 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:41:32.922930 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:32.923615 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:32.932859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:32.933584 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:32.936318 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:32.936968 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:33.100659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:33.101267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:33.113808 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:33.117402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:33.120277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:33.120714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:33.221621 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:33.230291 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f2473c68-d9f1-4d89-a3ff-95df80297d4e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.311648 Jun 16 16:41:33.230888 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 87/172] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:32 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:33.502627 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:33.503338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:33.520070 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:33.524641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:33.542777 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:33.543333 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:33.670596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:33.676655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:33.680426 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5cfab3ff-c202-4c31-b99a-a5a4d9ae80a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1315 microversion: 2.1 time: 0.584631 Jun 16 16:41:33.680980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 86/173] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:33 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:33.857443 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:33.869409 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:33.871500 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:33.872922 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e7b06d66-60a1-488b-8f61-e47db684db4c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.375150 Jun 16 16:41:33.873729 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 88/174] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:33 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:34.249830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:34.250739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:34.265139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:34.265615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:34.266394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:34.269060 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:34.510550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:34.519440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8ac0d552-5ea8-4aa7-ac5d-e2dca79c563d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.274914 Jun 16 16:41:34.520507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 87/175] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:34 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:34.698897 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:34.699647 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:34.707147 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:34.707594 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:34.708803 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:34.711169 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:34.895090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:34.896540 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:34.924925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:34.925239 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:34.926073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:34.931740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:34.960259 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:34.988491 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-25222b40-233b-4f61-a4d4-0d313fdd5f94 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1502 microversion: 2.1 time: 0.292514 Jun 16 16:41:35.003662 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 89/176] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:34 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1502 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:35.240383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:35.260943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:35.263627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:35.265228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c8e32993-fd11-4089-8d4c-fccf362d5198 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.374979 Jun 16 16:41:35.266424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 88/177] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:34 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:41:35.543865 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:35.545095 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:35.561348 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:35.562366 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:35.563790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:35.564237 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:35.828263 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:35.840446 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-67fda3bc-6565-45af-91e5-525155688623 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.301319 Jun 16 16:41:35.840446 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 90/178] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:35 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:36.299611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:36.300471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:36.308758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:36.309770 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:36.311929 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:36.312601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:36.613309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:36.623748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:36.625567 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:36.626976 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-55bfb989-50db-49c0-bae9-5b451fac1970 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.334317 Jun 16 16:41:36.638532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 89/179] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:36 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:36.858139 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:36.859316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:36.867830 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:36.868462 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:36.869486 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:36.869994 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:37.280281 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:37.287900 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-afd4ffcf-0f38-48cc-89ff-c1e9ef0ff123 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.436424 Jun 16 16:41:37.288471 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 91/180] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:36 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:37.650556 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:37.651607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:37.657581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:37.658024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:37.658786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:37.659422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:37.799215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:37.807397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:37.809433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:37.810525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a8480a6d-5ced-4dde-bb95-49bf138cfafa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.163841 Jun 16 16:41:37.811116 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 90/181] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:37 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:38.305411 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:38.305977 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:38.308014 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:38.313867 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:38.314310 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:38.315095 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:38.315508 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:38.451138 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:38.458593 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0130faa6-ea29-44ea-ab90-f30ed142dc7b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.157159 Jun 16 16:41:38.459199 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 92/182] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:38 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:38.829446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:38.829959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:38.831865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=73 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:38.838797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:38.838797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:38.838797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:38.839229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:38.980838 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:38.993240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:38.995674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:38.997342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8795b8c1-4f45-4ded-9d3d-a022f21bd0c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.171963 Jun 16 16:41:38.997844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 91/183] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:38 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:39.476982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:39.477686 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:39.485344 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:39.485787 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:39.486544 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:39.486965 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:39.621813 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:39.634701 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-464a639f-50f9-48a2-8178-7c8d8d5bde49 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.161939 Jun 16 16:41:39.636860 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 93/184] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:39 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:40.020260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:40.021051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:40.028030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:40.029194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:40.030438 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:40.031709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:40.193819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:40.202811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:40.204587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:40.205856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-38456396-8582-4b10-bd45-6362e1521acb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.189751 Jun 16 16:41:40.206941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 92/185] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:40 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:40.229691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-3612c8ff-50f7-48f1-8822-3a5e10bb7618 req-857eb2c6-e343-4537-bb16-75bc36ad66a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f89d4-2837-48f0-854e-4267acb270bb", "name": "network-vif-plugged", "status": "completed", "tag": "6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:40.239225 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-3612c8ff-50f7-48f1-8822-3a5e10bb7618 req-857eb2c6-e343-4537-bb16-75bc36ad66a3 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:40.239808 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-3612c8ff-50f7-48f1-8822-3a5e10bb7618 req-857eb2c6-e343-4537-bb16-75bc36ad66a3 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:40.254043 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-3612c8ff-50f7-48f1-8822-3a5e10bb7618 req-857eb2c6-e343-4537-bb16-75bc36ad66a3 service nova] Creating event network-vif-plugged:6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d for instance 0b7f89d4-2837-48f0-854e-4267acb270bb on hv-cinder-83735 Jun 16 16:41:40.260004 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-3612c8ff-50f7-48f1-8822-3a5e10bb7618 req-857eb2c6-e343-4537-bb16-75bc36ad66a3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034558 Jun 16 16:41:40.261106 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 94/186] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:41:40.652776 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:40.653994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:40.660802 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:40.661247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:40.662037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:40.662467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:40.795965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:40.803764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c58b9de6-92a8-4d43-88fc-a6eb32529ed5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1366 microversion: 2.1 time: 0.155011 Jun 16 16:41:40.804305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 93/187] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:40 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:41.225730 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:41.226909 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:41.233854 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:41.234571 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:41.235486 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:41.236005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:41.415370 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:41.424636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:41.426212 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:41.427341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8f5a6fd7-dc60-4dda-8a92-11d3ad0f2a05 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.206034 Jun 16 16:41:41.427909 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 95/188] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:41 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:41.822433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:41.823211 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:41.835764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:41.836562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:41.837938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:41.838354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:41.867785 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b5e713d7-c3af-427b-b025-7d09fa050850 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc70e81d-ac7c-4c25-91a8-716a1d6ebca4"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:41.868924 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b5e713d7-c3af-427b-b025-7d09fa050850 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:41.882628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5e713d7-c3af-427b-b025-7d09fa050850 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:41.883680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5e713d7-c3af-427b-b025-7d09fa050850 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:41.884897 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5e713d7-c3af-427b-b025-7d09fa050850 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:41.885641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5e713d7-c3af-427b-b025-7d09fa050850 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:41.983929 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:41.991772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1f98187f-d73b-4943-9baa-39fb7ba25816 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1556 microversion: 2.1 time: 0.175307 Jun 16 16:41:41.992325 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 94/189] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:41 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1556 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:42.010035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d6956b3f-2309-444d-a10e-40ced93ef593 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:42.010531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d6956b3f-2309-444d-a10e-40ced93ef593 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:42.017260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d6956b3f-2309-444d-a10e-40ced93ef593 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:42.017707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d6956b3f-2309-444d-a10e-40ced93ef593 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:42.018681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d6956b3f-2309-444d-a10e-40ced93ef593 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:42.019119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d6956b3f-2309-444d-a10e-40ced93ef593 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:42.145063 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d6956b3f-2309-444d-a10e-40ced93ef593 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.139037 Jun 16 16:41:42.145811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 95/190] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:41:42 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:42.446011 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:42.446618 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:42.452945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:42.453379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:42.454135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:42.454559 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:42.992702 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b5e713d7-c3af-427b-b025-7d09fa050850 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "POST /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.128670 Jun 16 16:41:42.993377 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 96/191] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:41:41 2022] POST /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c/os-volume_attachments => generated 194 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:41:43.027496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:43.036720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:43.038315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:43.039833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6b320713-1452-46de-b811-993f6c10a3c8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1406 microversion: 2.20 time: 0.597845 Jun 16 16:41:43.040827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 96/192] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:42 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1406 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:43.289763 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1841181825", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "networks": [{"uuid": "2493fa2a-e1b3-4148-b61e-a44c59685ae3"}]}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:43.303248 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=72 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:43.393003 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.network.neutron [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] validate_networks() for [('2493fa2a-e1b3-4148-b61e-a44c59685ae3', None, None, None, None, None)] {{(pid=124103) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:41:43.628272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-4c92b3f1-1aad-475a-9d0a-775680088731 req-952c6e6c-a3f4-401a-8b2e-cd56e6d80e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a54ec605-c392-472a-a282-72b1631a9f92", "tag": "ec2a77a9-ab99-44ef-b4b5-4d131163de17"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:43.637542 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-4c92b3f1-1aad-475a-9d0a-775680088731 req-952c6e6c-a3f4-401a-8b2e-cd56e6d80e7c service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:43.638237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-4c92b3f1-1aad-475a-9d0a-775680088731 req-952c6e6c-a3f4-401a-8b2e-cd56e6d80e7c service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:43.651267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-4c92b3f1-1aad-475a-9d0a-775680088731 req-952c6e6c-a3f4-401a-8b2e-cd56e6d80e7c service nova] Creating event network-changed:ec2a77a9-ab99-44ef-b4b5-4d131163de17 for instance a54ec605-c392-472a-a282-72b1631a9f92 on hv-cinder-83735 Jun 16 16:41:43.657051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-4c92b3f1-1aad-475a-9d0a-775680088731 req-952c6e6c-a3f4-401a-8b2e-cd56e6d80e7c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032764 Jun 16 16:41:43.658221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 97/193] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:43.835721 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Flavor limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:41:43.836206 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Image limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:41:43.836746 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Flavor pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:41:43.837309 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Image pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:41:43.837717 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:41:43.853587 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:43.854031 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:43.854817 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:43.855278 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:43.873187 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Getting quotas for project 7df664c6311a4aefb792aa792ebc17fa. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:41:43.877279 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Getting quotas for user f9aced17fa4848ecb0d5be31b87e1e5a and project 7df664c6311a4aefb792aa792ebc17fa. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:41:43.889044 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Going to run 1 instances... {{(pid=124103) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:41:43.891445 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:41:43.942536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5d1c484c-3fa8-4f2c-bb71-d370576826d8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659622 Jun 16 16:41:43.955162 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 97/194] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:41:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:41:43.956278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a9ac38ac-6f12-48f8-807b-5aed674d7143 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:43.957073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a9ac38ac-6f12-48f8-807b-5aed674d7143 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:44.033889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a9ac38ac-6f12-48f8-807b-5aed674d7143 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:44.042601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a9ac38ac-6f12-48f8-807b-5aed674d7143 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1214 microversion: 2.1 time: 0.090945 Jun 16 16:41:44.043722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 98/195] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:43 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:44.058889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:44.059541 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:44.066628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:44.066811 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:44.068227 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:44.068648 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:44.247448 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:44.261112 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:44.264074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:44.265983 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2db597cf-d12b-4053-ae60-72c5d3cdd53a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1598 microversion: 2.20 time: 0.210941 Jun 16 16:41:44.266558 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 98/196] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:41:44 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1598 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:41:44.285124 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f5c226db-4c90-436b-93b1-4348285e21d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:44.285642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f5c226db-4c90-436b-93b1-4348285e21d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:44.292296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5c226db-4c90-436b-93b1-4348285e21d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:44.292781 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5c226db-4c90-436b-93b1-4348285e21d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:44.294417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5c226db-4c90-436b-93b1-4348285e21d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:44.295090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5c226db-4c90-436b-93b1-4348285e21d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:44.381569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f5c226db-4c90-436b-93b1-4348285e21d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100409 Jun 16 16:41:44.389790 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 99/197] 10.222.0.74 () {60 vars in 1315 bytes} [Thu Jun 16 16:41:44 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 16 16:41:45.060212 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:45.061434 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:45.068843 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:45.069619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:45.070536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:45.071295 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:45.145976 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:45.155400 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f60013ad-d45b-457e-aaa7-1e035c8ad8d3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1266 microversion: 2.1 time: 0.099483 Jun 16 16:41:45.165143 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 99/198] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:45 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:45.675424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-5ae6832d-5a38-4289-924f-476f1fda532b req-8b21bcc3-5080-4cdf-aa0c-91618f0eb486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b7f89d4-2837-48f0-854e-4267acb270bb", "tag": "6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:45.692852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5ae6832d-5a38-4289-924f-476f1fda532b req-8b21bcc3-5080-4cdf-aa0c-91618f0eb486 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:45.695690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5ae6832d-5a38-4289-924f-476f1fda532b req-8b21bcc3-5080-4cdf-aa0c-91618f0eb486 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:45.710704 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-5ae6832d-5a38-4289-924f-476f1fda532b req-8b21bcc3-5080-4cdf-aa0c-91618f0eb486 service nova] Creating event network-changed:6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d for instance 0b7f89d4-2837-48f0-854e-4267acb270bb on hv-cinder-83735 Jun 16 16:41:45.717596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-5ae6832d-5a38-4289-924f-476f1fda532b req-8b21bcc3-5080-4cdf-aa0c-91618f0eb486 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048335 Jun 16 16:41:45.718685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 100/199] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:46.174937 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:46.176782 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:46.184407 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:46.185159 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:46.185947 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:46.186546 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:46.292514 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:46.301758 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c228981d-21d8-42d5-bf5b-8880f8656bca tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1272 microversion: 2.1 time: 0.132067 Jun 16 16:41:46.302328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 100/200] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:46 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1272 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:47.320832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:47.321596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:47.328185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:47.328722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:47.329534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:47.330008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:47.471615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:47.479328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0d53d187-50ec-4998-9a12-8c4b4bdd68bd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.163824 Jun 16 16:41:47.479907 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 101/201] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:47 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:47.940841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-42edfc9e-78b3-4adc-b12a-2434e8dd26a3 req-a9ca5e1b-4dcd-4083-b43c-664adbe1f662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0444d6f8-a943-4a89-bd74-eab1a6149bad", "tag": "fda99992-1b77-4394-9cd0-d4200976c8b0"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:41:47.949783 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-42edfc9e-78b3-4adc-b12a-2434e8dd26a3 req-a9ca5e1b-4dcd-4083-b43c-664adbe1f662 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:47.950328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-42edfc9e-78b3-4adc-b12a-2434e8dd26a3 req-a9ca5e1b-4dcd-4083-b43c-664adbe1f662 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:47.961032 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-42edfc9e-78b3-4adc-b12a-2434e8dd26a3 req-a9ca5e1b-4dcd-4083-b43c-664adbe1f662 service nova] Creating event network-changed:fda99992-1b77-4394-9cd0-d4200976c8b0 for instance 0444d6f8-a943-4a89-bd74-eab1a6149bad on hv-cinder-83735 Jun 16 16:41:47.966597 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-42edfc9e-78b3-4adc-b12a-2434e8dd26a3 req-a9ca5e1b-4dcd-4083-b43c-664adbe1f662 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029690 Jun 16 16:41:47.967585 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 101/202] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:41:48.500460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:48.501930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:48.513347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:48.513786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:48.514553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:48.514976 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:48.654061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:48.661969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-975f0793-a5d9-4062-aa81-69940b886b4b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.168165 Jun 16 16:41:48.662499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 102/203] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:48 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:49.678751 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:49.679535 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:49.686159 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:49.686594 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:49.687394 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:49.687812 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:49.818796 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:49.822458 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:49.828827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-51352ab5-8db8-4b0d-9ee8-d8b719a290e2 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.154788 Jun 16 16:41:49.829413 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 102/204] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:49 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:50.845687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:50.846254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:50.852652 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:50.853090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:50.853844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:50.854285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:51.009701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:51.017879 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-46faffbb-e09e-4986-8759-5cb78a21f646 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.176414 Jun 16 16:41:51.018796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 103/205] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:50 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:52.037759 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:52.038516 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:52.048072 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:52.048732 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:52.049940 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:52.050558 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:52.190042 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:52.197901 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9b19e200-e2ea-44c0-97d3-bf58e32f88f0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.166214 Jun 16 16:41:52.198478 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 103/206] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:52 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:53.218197 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:53.218753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:53.226468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:53.226949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:53.227859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:53.228316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:53.363636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:53.373154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7a1d669c-a222-42a1-9b1a-9aca7a7dcddc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.160174 Jun 16 16:41:53.374108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 104/207] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:53 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:54.391157 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:54.391764 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:54.394108 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:54.394763 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=6 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:54.401063 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:54.401499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:54.402251 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:54.402671 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:54.544385 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:54.552216 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f96d6965-0e40-4aed-b640-5fe23af9c179 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.165946 Jun 16 16:41:54.552796 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 104/208] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:54 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:55.572448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:55.573049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:55.576763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:55.581060 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:55.581913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:55.582869 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:55.583335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:55.724539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:55.733229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-09e58bda-1c83-4d33-a91b-4a629a489c2e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.164815 Jun 16 16:41:55.733845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 105/209] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:55 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:56.141194 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:56.141776 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:56.148250 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:56.148740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:56.149487 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:56.149950 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:56.178353 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Going to try to terminate instance {{(pid=124103) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:41:56.280575 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0ecf52f5-39f3-43ae-9c54-156311a748fc tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "DELETE /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 204 len: 0 microversion: 2.1 time: 0.143681 Jun 16 16:41:56.281362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 105/210] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:41:56 2022] DELETE /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:41:56.290899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:56.291638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:56.298297 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:56.298861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:56.299874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:56.300290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:56.319184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:41:56.438863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:56.448669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0c579ae4-5f2d-4545-9b3f-cad44e8cc3a1 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1554 microversion: 2.1 time: 0.162763 Jun 16 16:41:56.449567 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 106/211] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:56 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:41:56.750321 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:56.751481 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:56.759387 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:56.759835 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:56.760555 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:56.761007 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:56.902599 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:56.910853 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-974fea80-6b8f-4d52-9061-8f7791bfd1dd tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.164948 Jun 16 16:41:56.920978 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 106/212] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:56 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:57.466903 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:57.467596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:57.474177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:57.474692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:57.475617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:57.476043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:57.643262 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:57.666335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5712377e-e8aa-43f3-9f7d-712bcc9468b4 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1554 microversion: 2.1 time: 0.193343 Jun 16 16:41:57.666335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 107/213] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:57 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:57.928417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:57.929733 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:57.937804 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:57.938250 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:57.939364 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:57.940120 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:58.087701 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:58.096798 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9258c7c6-02f7-4ea6-a3cb-4214c77193e3 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.172168 Jun 16 16:41:58.097383 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 107/214] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:57 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:58.675083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:58.676253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:58.683354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:58.683913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:58.684791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:58.685308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:58.833599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:58.843384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5adb8286-76f6-4281-93c4-11c569cd994e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1554 microversion: 2.1 time: 0.172697 Jun 16 16:41:58.843918 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 108/215] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:58 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:59.113859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:59.115003 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:59.121762 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:59.122548 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:59.123498 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:59.123934 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:59.280657 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:41:59.290193 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1f267d2d-920b-457b-acc3-543174427e8f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.180382 Jun 16 16:41:59.299855 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 108/216] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:59 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:41:59.860444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:41:59.861064 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:41:59.867240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:59.867753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:41:59.868503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:41:59.869583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:00.213134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:00.222153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-719b26ee-9d8e-46ee-a0ab-45fc89c84da6 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1554 microversion: 2.1 time: 0.365674 Jun 16 16:42:00.232070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 109/217] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:41:59 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:00.307171 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:00.308414 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:00.315041 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:00.315641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:00.316401 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:00.316831 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:00.459270 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:00.468096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-bdcfa72d-342e-4e2c-bdc6-b3b4aae452c1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.164872 Jun 16 16:42:00.468694 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 109/218] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:00 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:01.239397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:01.240232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:01.246780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:01.247260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:01.248173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:01.248620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:01.395299 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:01.403925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-353e71e4-36f2-4bc9-99e2-a8d01052009e tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1554 microversion: 2.1 time: 0.168881 Jun 16 16:42:01.404499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 110/219] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:01 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:01.485419 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:01.486124 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:01.492693 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:01.493135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:01.493892 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:01.494320 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:01.636636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:01.644703 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-41592f9b-cf82-4047-96c4-7e1af38278de tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.163691 Jun 16 16:42:01.645284 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 110/220] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:01 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:02.423683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:02.424297 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:02.434514 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:02.435092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:02.438599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:02.440279 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:02.631394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:02.638757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3882214b-68ff-4395-959c-e556fa9ba0b9 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1554 microversion: 2.1 time: 0.219946 Jun 16 16:42:02.639479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 111/221] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:02 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:42:02.662313 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:02.663096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:02.673409 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:02.674132 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:02.675328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:02.675903 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:02.966524 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:02.968054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-e67ebf8c-68ad-4789-abbd-bc75ec4a3ebb req-0f7414d8-1f2b-4c2d-9a61-cc1f28a249b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da37036e-0eba-448b-bffc-2e8601b8165c", "name": "network-vif-deleted", "tag": "ae17f4d3-5698-43d8-97e1-dd1f94c90140"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:02.977391 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-54edc323-f4c2-4c4f-b3bc-9e6010aef4c6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.319329 Jun 16 16:42:02.987638 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 111/222] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:02 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:02.989784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-e67ebf8c-68ad-4789-abbd-bc75ec4a3ebb req-0f7414d8-1f2b-4c2d-9a61-cc1f28a249b5 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:02.990474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-e67ebf8c-68ad-4789-abbd-bc75ec4a3ebb req-0f7414d8-1f2b-4c2d-9a61-cc1f28a249b5 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:03.003835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-e67ebf8c-68ad-4789-abbd-bc75ec4a3ebb req-0f7414d8-1f2b-4c2d-9a61-cc1f28a249b5 service nova] Creating event network-vif-deleted:ae17f4d3-5698-43d8-97e1-dd1f94c90140 for instance da37036e-0eba-448b-bffc-2e8601b8165c on hv-cinder-83735 Jun 16 16:42:03.010886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-e67ebf8c-68ad-4789-abbd-bc75ec4a3ebb req-0f7414d8-1f2b-4c2d-9a61-cc1f28a249b5 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047825 Jun 16 16:42:03.011545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 112/223] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:03.658061 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:03.658680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:03.665003 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:03.666189 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:03.667326 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:03.667900 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:03.706434 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:03.706880 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:03.707359 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.objects.instance [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lazy-loading 'fault' on Instance uuid da37036e-0eba-448b-bffc-2e8601b8165c {{(pid=124103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:42:03.757902 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ab5b939a13e43469b3a4a48da559c83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a7a93f8b61c48759abc98e8b86ad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:03.766284 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-190c3789-4d64-4cad-b1fe-6b4c785f7a07 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 200 len: 1351 microversion: 2.1 time: 0.113388 Jun 16 16:42:03.767590 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 112/224] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:03 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:03.886005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-0d7e77a3-d673-4b85-8570-409e8f8253cd req-fd4a0171-e3a1-4763-b980-d3a0d431aa3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0444d6f8-a943-4a89-bd74-eab1a6149bad", "name": "network-vif-plugged", "status": "completed", "tag": "fda99992-1b77-4394-9cd0-d4200976c8b0"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:03.891608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-0d7e77a3-d673-4b85-8570-409e8f8253cd req-fd4a0171-e3a1-4763-b980-d3a0d431aa3e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:03.892240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-0d7e77a3-d673-4b85-8570-409e8f8253cd req-fd4a0171-e3a1-4763-b980-d3a0d431aa3e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:03.904633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-0d7e77a3-d673-4b85-8570-409e8f8253cd req-fd4a0171-e3a1-4763-b980-d3a0d431aa3e service nova] Creating event network-vif-plugged:fda99992-1b77-4394-9cd0-d4200976c8b0 for instance 0444d6f8-a943-4a89-bd74-eab1a6149bad on hv-cinder-83735 Jun 16 16:42:03.910855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-0d7e77a3-d673-4b85-8570-409e8f8253cd req-fd4a0171-e3a1-4763-b980-d3a0d431aa3e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032184 Jun 16 16:42:03.911804 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 113/225] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:03.993560 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:03.994227 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:04.001322 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:04.001735 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:04.002512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:04.003202 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:04.239441 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:04.247903 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-40fa72e6-7ff5-44c6-ac32-58beb01aabbe tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.257890 Jun 16 16:42:04.248701 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 113/226] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:03 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:04.784793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:04.785519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:04.792776 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:04.793128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:04.793945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:04.794365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:04.808273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] HTTP exception thrown: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Request method failure captured: Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c HTTP/1.1 Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MzZOJvawl7DN9dlgY9qopoo7a7jnoZU4cNOK8ipO7wiGkAOji4tTUPnfnLagMfqEGvuXbN920T5EEcPNWnplgp3q_REbclBHsQv7qbZt06U36r9n3DUgOitmyJAvbFxKL0s-Cr5DOgrGnJB7VSG0gw8euTMkEqx1VGpgjSjmrYjk Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:42:04.812867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab5b939a13e43469b3a4a48da559c83 Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.814122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'da37036e-0eba-448b-bffc-2e8601b8165c'} Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:42:04.814876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.816207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.817292 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Returning 404 to user: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:42:04.817292 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c5583e7a-bdfa-4800-a9d5-f8a2703c6aac tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 404 len: 111 microversion: 2.1 time: 0.033707 Jun 16 16:42:04.818065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 114/227] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:04 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:42:04.924134 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:04.925314 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:04.932338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:04.932784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:04.933541 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:04.934327 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:04.957656 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] HTTP exception thrown: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Request method failure captured: Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: request: GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c/os-volume_attachments HTTP/1.1 Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept: application/json Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept-Encoding: identity Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Connection: close Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Length: 0 Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Type: application/json Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Host: 10.222.0.74 Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Openstack-System-Scope: None Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: User-Agent: python-urllib3/1.26.9 Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Auth-Token: gAAAAABiq10MzZOJvawl7DN9dlgY9qopoo7a7jnoZU4cNOK8ipO7wiGkAOji4tTUPnfnLagMfqEGvuXbN920T5EEcPNWnplgp3q_REbclBHsQv7qbZt06U36r9n3DUgOitmyJAvbFxKL0s-Cr5DOgrGnJB7VSG0gw8euTMkEqx1VGpgjSjmrYjk Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Id: None Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Name: None Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Identity-Status: Confirmed Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Is-Admin-Project: True Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Id: default Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Name: Default Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Role: reader,member Jun 16 16:42:04.961876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Roles: reader,member Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Id: default Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Name: Default Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Id: 5ab5b939a13e43469b3a4a48da559c83 Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Name: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: method: > Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: exception: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.963367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: action_args: {'server_id': 'da37036e-0eba-448b-bffc-2e8601b8165c'} Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:42:04.964067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:04.965090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:04.967684 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Returning 404 to user: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:42:04.968537 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f118f636-2994-4983-b34f-343b5b129004 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.050196 Jun 16 16:42:04.969104 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 114/228] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:42:04 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:42:05.265766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:05.266378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:05.272438 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:05.272885 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:05.273633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:05.274047 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:05.412509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:05.420680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fa8b5b33-fe2d-45ce-a75d-4a6108c51e2c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1314 microversion: 2.1 time: 0.158783 Jun 16 16:42:05.421234 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 115/229] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:05 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:06.441031 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:06.441731 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:06.448852 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:06.449388 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:06.450417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:06.450923 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:06.660735 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:06.668733 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-75a6b704-46ca-45e0-8ce0-8e61cd8efc59 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1498 microversion: 2.1 time: 0.234943 Jun 16 16:42:06.670215 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 115/230] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:06 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:07.301437 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:07.302371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:07.312716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.313653 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:07.314634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.315665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:07.334681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] HTTP exception thrown: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Request method failure captured: Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c HTTP/1.1 Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MzZOJvawl7DN9dlgY9qopoo7a7jnoZU4cNOK8ipO7wiGkAOji4tTUPnfnLagMfqEGvuXbN920T5EEcPNWnplgp3q_REbclBHsQv7qbZt06U36r9n3DUgOitmyJAvbFxKL0s-Cr5DOgrGnJB7VSG0gw8euTMkEqx1VGpgjSjmrYjk Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:42:07.337005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab5b939a13e43469b3a4a48da559c83 Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.338200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'da37036e-0eba-448b-bffc-2e8601b8165c'} Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:42:07.338852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.339947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.341865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Returning 404 to user: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:42:07.341865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fc1c6597-4527-4f07-9480-4988395e43ad tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "DELETE /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 404 len: 111 microversion: 2.1 time: 0.045148 Jun 16 16:42:07.346127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 116/231] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:42:07 2022] DELETE /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:42:07.362807 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:07.364214 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] [instance: da37036e-0eba-448b-bffc-2e8601b8165c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:07.365424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:07.366068 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:07.370684 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.371208 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:07.373325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.373932 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:07.376605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.377551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:07.379010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.379010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:07.392468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] HTTP exception thrown: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Request method failure captured: Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: request: GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c HTTP/1.1 Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept: application/json Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept-Encoding: identity Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Connection: close Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Length: 0 Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Type: application/json Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Host: 10.222.0.74 Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Openstack-System-Scope: None Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: User-Agent: python-urllib3/1.26.9 Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Auth-Token: gAAAAABiq10MzZOJvawl7DN9dlgY9qopoo7a7jnoZU4cNOK8ipO7wiGkAOji4tTUPnfnLagMfqEGvuXbN920T5EEcPNWnplgp3q_REbclBHsQv7qbZt06U36r9n3DUgOitmyJAvbFxKL0s-Cr5DOgrGnJB7VSG0gw8euTMkEqx1VGpgjSjmrYjk Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Id: None Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Name: None Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Identity-Status: Confirmed Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Is-Admin-Project: True Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Id: default Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Name: Default Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Role: reader,member Jun 16 16:42:07.395176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Roles: reader,member Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0a7a93f8b61c48759abc98e8b86ad4e8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Id: 0a7a93f8b61c48759abc98e8b86ad4e8 Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Name: tempest-DeleteServersTestJSON-1909646133 Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Id: default Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Name: Default Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Id: 5ab5b939a13e43469b3a4a48da559c83 Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Name: tempest-DeleteServersTestJSON-1909646133-project Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: method: > Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: exception: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.396390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: action_args: {'id': 'da37036e-0eba-448b-bffc-2e8601b8165c'} Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:42:07.397019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. Jun 16 16:42:07.398512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:07.399488 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] Returning 404 to user: Instance da37036e-0eba-448b-bffc-2e8601b8165c could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:42:07.399488 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1c864032-22d1-4ef2-9b29-aa3797878f71 tempest-DeleteServersTestJSON-1909646133 tempest-DeleteServersTestJSON-1909646133-project] 10.222.0.74 "GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c" status: 404 len: 111 microversion: 2.1 time: 0.050220 Jun 16 16:42:07.399488 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 116/232] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:07 2022] GET /compute/v2.1/servers/da37036e-0eba-448b-bffc-2e8601b8165c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:42:07.418444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:42:07.571603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-676d4f69-9e3f-4ee0-bd10-fbedffdc2929 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 204 len: 0 microversion: 2.1 time: 0.210131 Jun 16 16:42:07.572477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 117/233] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:42:07 2022] DELETE /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:42:07.581459 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:07.582223 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:07.588682 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.589248 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:07.590003 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:07.590653 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:08.077235 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:08.089067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1c30a704-baf8-40d0-8367-baf6da5a3e30 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1504 microversion: 2.1 time: 0.511395 Jun 16 16:42:08.091659 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 117/234] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:07 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1504 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:09.108936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:09.109687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:09.115443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:09.117440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:09.118945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:09.118945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:09.119413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:09.345188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:09.354916 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d81872cb-8333-4740-a1c8-a6bbe9f3e25e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1504 microversion: 2.1 time: 0.250537 Jun 16 16:42:09.355546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 118/235] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:09 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:10.373855 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:10.375219 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:10.387022 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:10.388182 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:10.390219 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:10.391158 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:10.828009 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:10.832117 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:10.845845 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3bce2cf4-c124-43c7-aaee-508ccd5bfe62 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1504 microversion: 2.1 time: 0.477324 Jun 16 16:42:10.848013 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 118/236] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:10 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:11.162149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-6b7774e9-67ed-40b7-ad58-a220d94cdb0c req-a34d4469-2658-4461-9825-6dc50d91c45a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0444d6f8-a943-4a89-bd74-eab1a6149bad", "name": "network-vif-deleted", "tag": "fda99992-1b77-4394-9cd0-d4200976c8b0"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:11.178719 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6b7774e9-67ed-40b7-ad58-a220d94cdb0c req-a34d4469-2658-4461-9825-6dc50d91c45a service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:11.179718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6b7774e9-67ed-40b7-ad58-a220d94cdb0c req-a34d4469-2658-4461-9825-6dc50d91c45a service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:11.193575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-6b7774e9-67ed-40b7-ad58-a220d94cdb0c req-a34d4469-2658-4461-9825-6dc50d91c45a service nova] Creating event network-vif-deleted:fda99992-1b77-4394-9cd0-d4200976c8b0 for instance 0444d6f8-a943-4a89-bd74-eab1a6149bad on hv-cinder-83735 Jun 16 16:42:11.228739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-6b7774e9-67ed-40b7-ad58-a220d94cdb0c req-a34d4469-2658-4461-9825-6dc50d91c45a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071567 Jun 16 16:42:11.230870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 119/237] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:11.872259 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:11.872879 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:11.904980 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:11.905684 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:11.906993 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:11.910947 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:12.026737 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:12.028074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:12.029526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.objects.instance [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lazy-loading 'fault' on Instance uuid 0444d6f8-a943-4a89-bd74-eab1a6149bad {{(pid=124103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:42:12.100500 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:12.109377 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fbf6687c-fc21-4c32-b11d-1bdbcaad43e0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 200 len: 1304 microversion: 2.1 time: 0.248468 Jun 16 16:42:12.110276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 119/238] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:11 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 1304 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:13.126771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:13.127639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 0444d6f8-a943-4a89-bd74-eab1a6149bad] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:13.141591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:13.142128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:13.143194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:13.143778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:13.178030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] HTTP exception thrown: Instance 0444d6f8-a943-4a89-bd74-eab1a6149bad could not be found. Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Request method failure captured: Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad HTTP/1.1 Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq11BQiUcpkwk4C93n3FQw7tljduBOeWykS9ijD9GpG3UNNqTq_WUN4OUoRN11OMe6A5A0jjQ0UQNG7TKMg23qLLMNquE60tJcLTHPkbYEOHIaD7W76wwJfJrjuvyT4VG91Zl35w4z5qmzltJtzRKSjNRxwPq9ttHiCiLFo47QNaLaJo Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 7df664c6311a4aefb792aa792ebc17fa Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesActionsTest-501518164 Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:42:13.179694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesActionsTest-501518164 Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 7df664c6311a4aefb792aa792ebc17fa Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesActionsTest-501518164 Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesActionsTest-501518164-project Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: f9aced17fa4848ecb0d5be31b87e1e5a Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesActionsTest-501518164-project Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0444d6f8-a943-4a89-bd74-eab1a6149bad could not be found. Jun 16 16:42:13.180873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0444d6f8-a943-4a89-bd74-eab1a6149bad'} Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0444d6f8-a943-4a89-bd74-eab1a6149bad could not be found. Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:42:13.181554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0444d6f8-a943-4a89-bd74-eab1a6149bad could not be found. Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0444d6f8-a943-4a89-bd74-eab1a6149bad could not be found. Jun 16 16:42:13.182682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:42:13.194847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Returning 404 to user: Instance 0444d6f8-a943-4a89-bd74-eab1a6149bad could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:42:13.196223 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-21ae855d-6b15-4612-9e64-2004b428a7ab tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad" status: 404 len: 111 microversion: 2.1 time: 0.074270 Jun 16 16:42:13.197101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 120/239] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:13 2022] GET /compute/v2.1/servers/0444d6f8-a943-4a89-bd74-eab1a6149bad => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:42:13.388990 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1824259577", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "networks": [{"uuid": "2493fa2a-e1b3-4148-b61e-a44c59685ae3"}]}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:13.401196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:13.461248 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.network.neutron [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] validate_networks() for [('2493fa2a-e1b3-4148-b61e-a44c59685ae3', None, None, None, None, None)] {{(pid=124103) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:42:13.916253 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Flavor limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:42:13.916882 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Image limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:42:13.917517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Flavor pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:42:13.918253 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Image pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:42:13.919275 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:42:13.928387 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:13.928922 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:13.929867 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:13.930341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:13.948326 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Getting quotas for project 7df664c6311a4aefb792aa792ebc17fa. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:42:13.953329 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Getting quotas for user f9aced17fa4848ecb0d5be31b87e1e5a and project 7df664c6311a4aefb792aa792ebc17fa. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:42:13.964418 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Going to run 1 instances... {{(pid=124103) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:42:13.967309 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:42:14.025095 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5131e827-f505-4a14-b22b-5ba5b1219004 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.639851 Jun 16 16:42:14.025961 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 120/240] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:42:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:42:14.038621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-499968b6-be7a-4431-93e9-dd15ae6d7cc0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:14.039740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-499968b6-be7a-4431-93e9-dd15ae6d7cc0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:14.130441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-499968b6-be7a-4431-93e9-dd15ae6d7cc0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:14.138772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-499968b6-be7a-4431-93e9-dd15ae6d7cc0 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1214 microversion: 2.1 time: 0.104655 Jun 16 16:42:14.139491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 121/241] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:14 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1214 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:15.156788 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:15.157600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:15.164585 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:15.165099 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:15.165859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:15.166356 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:15.248187 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:15.256905 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d6a1073b-5d43-41a1-b193-aece44e36ae5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1266 microversion: 2.1 time: 0.104355 Jun 16 16:42:15.266653 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 121/242] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:15 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:16.274310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:16.275363 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:16.283450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:16.283879 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:16.285338 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:16.285768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:16.364270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:16.372700 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-346fd2d7-373c-4e25-af44-59d11141766c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1274 microversion: 2.1 time: 0.102400 Jun 16 16:42:16.404636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 122/243] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:16 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1274 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:17.390837 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:17.391663 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:17.398577 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:17.399163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:17.400026 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:17.400631 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:17.539179 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:17.553997 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cb32f10c-2f51-4ddf-84c1-6b1237d3e15c tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1274 microversion: 2.1 time: 0.168056 Jun 16 16:42:17.568537 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 122/244] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:17 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1274 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:18.576258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:18.577540 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:18.583882 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:18.584528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:18.585425 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:18.586126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:18.885124 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:18.900633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e35c3b5a-ff25-49f0-bcbf-0726ff404d47 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1274 microversion: 2.1 time: 0.327796 Jun 16 16:42:18.904606 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 123/245] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:18 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1274 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:19.920430 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:19.921666 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:19.929939 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:19.930555 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:19.931361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:19.931789 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:20.007024 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:20.027360 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-35a0f7a9-f4ad-4539-8c9b-288753287e56 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1272 microversion: 2.1 time: 0.110922 Jun 16 16:42:20.027981 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 123/246] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:19 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1272 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:20.140904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1668781664", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:20.193323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] validate_networks() for [('8ebf5a0f-51e6-4c75-979d-1bb269777efc', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:42:20.580998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:42:20.581611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:42:20.582246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:42:20.582825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:42:20.583262 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:42:20.592685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:20.593120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:20.593898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:20.594318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:20.611010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:42:20.615006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for user 86f1f2722c5c4da59fd83036ce1700e1 and project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:42:20.626270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:42:20.628574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:42:20.674912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b6074bee-bfed-48c5-bc81-e43ac4d7d500 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.653671 Jun 16 16:42:20.675623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 124/247] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:42:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:42:20.686058 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e5394a9a-9a82-4706-bda4-cb135e59a29e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:20.686929 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e5394a9a-9a82-4706-bda4-cb135e59a29e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:20.748759 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e5394a9a-9a82-4706-bda4-cb135e59a29e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:20.756183 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e5394a9a-9a82-4706-bda4-cb135e59a29e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1222 microversion: 2.1 time: 0.073632 Jun 16 16:42:20.756183 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 124/248] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:20 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1222 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:20.846044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1737274998", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:20.933683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] validate_networks() for [('8ebf5a0f-51e6-4c75-979d-1bb269777efc', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:42:21.046278 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:21.047938 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:21.060574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:21.061329 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:21.062285 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:21.069667 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:21.497620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:42:21.498054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:42:21.498520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:42:21.498859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:42:21.499611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:42:21.514109 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:21.514334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:21.514609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:21.516441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:21.518501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:21.525947 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-050fbe09-b12c-4564-a81f-2de4b359dbed tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.484737 Jun 16 16:42:21.533767 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 125/249] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:21 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:42:21.555664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:42:21.560376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for user 86f1f2722c5c4da59fd83036ce1700e1 and project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:42:21.571648 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:42:21.573770 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:42:21.675692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-08311d92-3e17-4aff-a283-c5c6c3dde146 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.834222 Jun 16 16:42:21.677009 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 125/250] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:42:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:42:21.692921 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c7796556-3ace-493e-acbb-fe02409199aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:21.693751 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c7796556-3ace-493e-acbb-fe02409199aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:21.814341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c7796556-3ace-493e-acbb-fe02409199aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:21.824902 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c7796556-3ace-493e-acbb-fe02409199aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1222 microversion: 2.1 time: 0.139472 Jun 16 16:42:21.826217 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 126/251] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:21 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:22.518281 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-ec398220-d6a3-42f1-b0c7-fd49f41af7f5 req-1edb27e9-34c7-42c8-b70e-866b45eec239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "518f2a57-94f9-4af5-b7b1-a7e6cb021f18", "tag": "46f4e2d8-c6ff-4d56-b8e2-93976a2373b4"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:22.551965 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:22.559712 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:22.575750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-ec398220-d6a3-42f1-b0c7-fd49f41af7f5 req-1edb27e9-34c7-42c8-b70e-866b45eec239 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:22.576513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-ec398220-d6a3-42f1-b0c7-fd49f41af7f5 req-1edb27e9-34c7-42c8-b70e-866b45eec239 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:22.580088 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:22.582898 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:22.586942 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:22.589687 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:22.612209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-ec398220-d6a3-42f1-b0c7-fd49f41af7f5 req-1edb27e9-34c7-42c8-b70e-866b45eec239 service nova] Creating event network-changed:46f4e2d8-c6ff-4d56-b8e2-93976a2373b4 for instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 on hv-cinder-83735 Jun 16 16:42:22.624617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-ec398220-d6a3-42f1-b0c7-fd49f41af7f5 req-1edb27e9-34c7-42c8-b70e-866b45eec239 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109335 Jun 16 16:42:22.625647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 126/252] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:22.842893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:22.851623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:22.874454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:22.874901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:22.878798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:22.879287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:23.112381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:23.113130 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:23.121125 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5ecd6677-3fee-4230-b8f1-9fda35a9cc5d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.581159 Jun 16 16:42:23.125419 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 127/253] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:22 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:23.125695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fa7d945e-6d21-41f9-b83f-b0b5e84fe811 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1218 microversion: 2.1 time: 0.287043 Jun 16 16:42:23.126285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 127/254] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:22 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1218 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:24.143792 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:24.144534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:24.145085 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:24.145700 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:24.155689 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:24.167136 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:24.170677 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:24.170854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:24.171556 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:24.175040 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:24.178298 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:24.181284 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:24.181916 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:24.228282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:24.293449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:24.302994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-900a809e-06fc-487c-88af-5ab48f2c4a9e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1280 microversion: 2.1 time: 0.163555 Jun 16 16:42:24.303655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 128/255] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:24 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1280 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:24.716146 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:24.732866 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-29a38b3b-9fbf-4bde-9f43-418a686be090 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.593427 Jun 16 16:42:24.733464 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 128/256] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:24 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:25.320516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:25.321126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:25.327606 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:25.328105 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:25.328818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:25.329236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:25.468203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:25.475923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-326912af-2efe-4d2f-b79f-8d588d6f3d5d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.159417 Jun 16 16:42:25.476547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 129/257] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:25 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:25.750635 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:25.751926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:25.759515 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:25.759959 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:25.760773 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:25.761202 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:25.894790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:25.902562 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-38238f93-0066-4ee2-a366-d468fa818bae tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.156371 Jun 16 16:42:25.903172 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 129/258] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:25 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:26.493573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:26.494330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:26.500676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:26.501340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:26.502294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:26.502912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:26.645926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:26.653654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6026faa6-3275-46d3-b182-33cbdc0e56e7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.164514 Jun 16 16:42:26.654229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 130/259] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:26 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:42:26.920009 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:26.920576 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:26.927754 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:26.928191 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:26.928946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:26.929369 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:27.065528 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:27.073163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0d9715c4-c9e4-4ede-8f54-e52269036a7f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.157183 Jun 16 16:42:27.075271 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 130/260] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:26 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:27.673146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:27.674339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:27.688854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:27.689802 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:27.692418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:27.694062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:27.953369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:27.967140 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-86da684f-4e12-4c7e-b2c4-96194cfd8ec7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.300296 Jun 16 16:42:27.993955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 131/261] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:27 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:28.090203 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:28.091684 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:28.098710 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:28.099188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:28.099956 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:28.100381 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:28.540928 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:28.563770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3e3a5f73-00ce-4553-baf1-a116230e7247 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.477919 Jun 16 16:42:28.564749 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 131/262] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:28 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:29.011957 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:29.012603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:29.022782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:29.023548 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:29.024502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:29.025081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:29.179757 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-b48cee85-7e98-4e06-a8da-e9bade41db58 req-22b1a528-6572-4fa1-bc87-cff37bae7f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f65e809-f39a-49b7-9749-16db6f08c895", "tag": "31bdfc94-2e19-40b3-95f4-02cd2109b918"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:29.190716 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-b48cee85-7e98-4e06-a8da-e9bade41db58 req-22b1a528-6572-4fa1-bc87-cff37bae7f72 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:29.196635 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-b48cee85-7e98-4e06-a8da-e9bade41db58 req-22b1a528-6572-4fa1-bc87-cff37bae7f72 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:29.241697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-b48cee85-7e98-4e06-a8da-e9bade41db58 req-22b1a528-6572-4fa1-bc87-cff37bae7f72 service nova] Creating event network-changed:31bdfc94-2e19-40b3-95f4-02cd2109b918 for instance 9f65e809-f39a-49b7-9749-16db6f08c895 on hv-cinder-83735 Jun 16 16:42:29.252345 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-b48cee85-7e98-4e06-a8da-e9bade41db58 req-22b1a528-6572-4fa1-bc87-cff37bae7f72 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076528 Jun 16 16:42:29.257340 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 132/263] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 16 16:42:29.267127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:29.277339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3d5f38c9-752a-47e6-af03-6219ff0e001c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.268612 Jun 16 16:42:29.291128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 132/264] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:29 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:29.581566 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:29.582247 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:29.602901 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:29.604626 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:29.613908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:29.614491 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:29.988123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:30.009795 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-08aec210-6b50-4298-b0a0-216db2487511 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.432486 Jun 16 16:42:30.021512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 133/265] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:29 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:30.299421 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:30.300038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:30.306543 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:30.306996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:30.307806 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:30.308242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:30.456227 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:30.464026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c80eae8d-83f3-4034-83e2-594394664b10 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.169971 Jun 16 16:42:30.467117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 133/266] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:30 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:31.029768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:31.030405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:31.039578 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:31.040052 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:31.041926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:31.044345 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:31.260272 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:31.272456 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6479016c-228e-4513-aeb3-8ee747b8bb89 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.246938 Jun 16 16:42:31.274133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 134/267] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:31 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:31.306067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-97832ef0-3a77-4194-bae5-10412abbe28e req-f0b76297-b5e6-41cb-9c7a-7250be1ae36e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6f57ed7-219e-4057-b423-462f36c3396c", "tag": "0da84472-5bcf-4cb0-a569-2a78afef6667"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:31.315171 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-97832ef0-3a77-4194-bae5-10412abbe28e req-f0b76297-b5e6-41cb-9c7a-7250be1ae36e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:31.315327 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-97832ef0-3a77-4194-bae5-10412abbe28e req-f0b76297-b5e6-41cb-9c7a-7250be1ae36e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:31.327343 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-97832ef0-3a77-4194-bae5-10412abbe28e req-f0b76297-b5e6-41cb-9c7a-7250be1ae36e service nova] Creating event network-changed:0da84472-5bcf-4cb0-a569-2a78afef6667 for instance d6f57ed7-219e-4057-b423-462f36c3396c on hv-cinder-83735 Jun 16 16:42:31.332452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-97832ef0-3a77-4194-bae5-10412abbe28e req-f0b76297-b5e6-41cb-9c7a-7250be1ae36e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030057 Jun 16 16:42:31.333377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 134/268] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:31.490403 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:31.491505 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:31.498097 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:31.498819 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:31.499789 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:31.500645 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:31.650026 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:31.657115 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6100474f-5aa3-47e3-bc28-bf8adc90472b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.179629 Jun 16 16:42:31.658018 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 135/269] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:31 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:32.287619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:32.288419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=14 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:32.299405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:32.300394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:32.317391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:32.318496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:32.319515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:32.319921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:32.549571 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:32.557340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8e1269c5-31e0-4797-99a7-c1f16a23c3a1 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.270664 Jun 16 16:42:32.557908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 135/270] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:32 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:32.676660 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:32.677336 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:32.679775 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=10 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:32.687128 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:32.687661 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:32.688508 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:32.689007 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:32.850258 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:32.871501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-14f42fef-0055-4638-b197-27348101cb86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.199263 Jun 16 16:42:32.872819 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 136/271] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:32 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:33.574188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:33.574803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:33.581043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:33.581854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:33.583667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:33.591203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:33.743169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:33.751662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4e455e5a-500a-414a-9224-abd1f2a1679d tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.181247 Jun 16 16:42:33.752630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 136/272] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:33 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:33.889134 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:33.890305 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:33.897543 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:33.898217 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:33.899319 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:33.899790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:34.100673 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:34.109012 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-bb00923c-a49e-4da8-abec-84e43ee5998c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.223776 Jun 16 16:42:34.109609 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 137/273] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:33 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:34.769598 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:34.770962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:34.782569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:34.783682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:34.785040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:34.788849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:35.024006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:35.055357 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-64e5bf43-a921-4f96-bbc3-e307b4661629 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.276944 Jun 16 16:42:35.056560 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 137/274] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:34 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:35.129412 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:35.131143 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:35.146215 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:35.146859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:35.147974 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:35.148583 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:35.168034 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:35.303476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:35.313778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8a68cf8a-7247-4418-af46-a4e544b58fdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.191670 Jun 16 16:42:35.314755 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 138/275] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:35 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:36.072727 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:36.073359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:36.082035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:36.082525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:36.083300 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:36.083729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:36.308791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:36.317204 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-00bff76a-ded5-4a6b-8c16-0e2cd65156c4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.248412 Jun 16 16:42:36.322230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 138/276] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:36 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:36.336651 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:36.337224 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:36.347284 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:36.347794 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:36.348570 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:36.349006 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:36.516704 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:36.524934 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2c7d99bc-2478-4de3-9f73-050c71d2ffb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.192215 Jun 16 16:42:36.525887 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 139/277] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:36 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:37.341807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:37.343882 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:37.355464 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:37.357413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:37.359874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:37.364140 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:37.546395 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:37.547654 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:37.558513 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:37.559205 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:37.562486 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:37.562989 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:37.715600 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:37.724122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-12bcaa48-9cee-441f-80f4-17768d9e18bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.389597 Jun 16 16:42:37.734133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 139/278] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:37 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:37.745544 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:37.754600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fb55d340-48c5-4b37-84d9-260dab03de90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.212685 Jun 16 16:42:37.766371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 140/279] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:37 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:38.233038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-a50f63bf-0e4f-4d4b-a2aa-032c70b01e92 req-18a6c06c-89c7-4e3e-b1d6-6ae7f697ff53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518f2a57-94f9-4af5-b7b1-a7e6cb021f18", "name": "network-vif-plugged", "status": "completed", "tag": "46f4e2d8-c6ff-4d56-b8e2-93976a2373b4"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:38.248118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-a50f63bf-0e4f-4d4b-a2aa-032c70b01e92 req-18a6c06c-89c7-4e3e-b1d6-6ae7f697ff53 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:38.250399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-a50f63bf-0e4f-4d4b-a2aa-032c70b01e92 req-18a6c06c-89c7-4e3e-b1d6-6ae7f697ff53 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:38.283937 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-a50f63bf-0e4f-4d4b-a2aa-032c70b01e92 req-18a6c06c-89c7-4e3e-b1d6-6ae7f697ff53 service nova] Creating event network-vif-plugged:46f4e2d8-c6ff-4d56-b8e2-93976a2373b4 for instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 on hv-cinder-83735 Jun 16 16:42:38.293979 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-a50f63bf-0e4f-4d4b-a2aa-032c70b01e92 req-18a6c06c-89c7-4e3e-b1d6-6ae7f697ff53 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064807 Jun 16 16:42:38.299410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 140/280] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:38.741459 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:38.742166 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:38.751552 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:38.753756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:38.754899 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:38.755502 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:38.775695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:38.777370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:38.790875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:38.794198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:38.796175 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:38.796797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:38.978332 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:38.989483 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6cf8e9db-6559-40dd-b48d-5f962db7f52a tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.252042 Jun 16 16:42:38.999368 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 141/281] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:38 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:39.180071 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:39.188552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5ad62bf0-2f88-4c3a-a315-46aee6e3b311 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.417089 Jun 16 16:42:39.190153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 141/282] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:38 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:40.010929 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:40.012083 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:40.020690 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:40.021133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:40.022168 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:40.022612 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:40.199361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:40.205917 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:40.206524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:40.212285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:40.213538 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9123603d-8ff5-4767-9733-a954b81315d6 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.209389 Jun 16 16:42:40.214271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:40.214873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:40.216391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:40.217044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:40.217342 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 142/283] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:40 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:40.475834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:40.485198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-be376e5d-d125-46e0-8046-54b24daa8628 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.283234 Jun 16 16:42:40.485887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 142/284] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:40 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:42:41.163938 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-28fdf099-d516-44cb-8c55-1031dc3144e7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Action: 'create', calling method: .version_select at 0x7fe5f8c1b4c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1503021758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHi6ETNvHuB9cdgIwOdsFisIt/vd4X+r1Lp2Os8iIPdZ+eE9vrvVt5eajFjQ+wV35luMZt11qcygOV1Y2gHzZpFLuPsbmSyn/HzYDVOOw7N2qpgDOUzIeyUmtdaDXZY1Q=="}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:41.190772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-28fdf099-d516-44cb-8c55-1031dc3144e7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Getting quotas for project c099988d7bdc415ab2f206cbe567e77b. Resources: {'key_pairs'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:42:41.195582 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-28fdf099-d516-44cb-8c55-1031dc3144e7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Getting quotas for user a47eeee1d19f4deb9402314872f7ba30 and project c099988d7bdc415ab2f206cbe567e77b. Resources: {'key_pairs'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:42:41.234267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:41.236529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-28fdf099-d516-44cb-8c55-1031dc3144e7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.285277 Jun 16 16:42:41.236799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:41.237349 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 143/285] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:42:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:41.246173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:41.246731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:41.250010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:41.251740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:41.463591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:41.482539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-374d3d13-524c-4e01-ad15-e89c69ec23a7 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.252122 Jun 16 16:42:41.483863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 143/286] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:41 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:41.502958 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:41.503600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:41.521979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:41.522436 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:41.523256 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:41.524013 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:41.714404 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:41.734722 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-19ec8ff6-b7e9-4b21-b240-5881ccecafe0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.236350 Jun 16 16:42:41.735349 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 144/287] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:41 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:42:42.500513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:42.501108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:42.507917 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:42.508357 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:42.509120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:42.509546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:42.652309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:42.660326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e190a5fa-c766-407e-af40-34bf80e6350f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.164407 Jun 16 16:42:42.661687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 144/288] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:42 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:42.753180 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:42.753789 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:42.760089 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:42.760534 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:42.761294 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:42.761777 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:42.912358 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:42.923960 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b1b47bb7-4748-4748-ac6d-921907f62aeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.174077 Jun 16 16:42:42.925464 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 145/289] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:42 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:43.679356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:43.679950 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:43.686300 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:43.686897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:43.687707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:43.688148 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:43.838137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:43.847071 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ad21cd3e-6754-4208-aca9-4e3bca9167bc tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.172396 Jun 16 16:42:43.851242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 145/290] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:43 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:43.948261 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:43.949007 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:43.958316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:43.960084 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:43.960818 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:43.961794 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:43.962257 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:44.116517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-56e9105f-8325-40e1-a1bf-f12778e6d97a req-ec9fafad-16db-4389-9089-d4fecd261a8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f65e809-f39a-49b7-9749-16db6f08c895", "name": "network-vif-plugged", "status": "completed", "tag": "31bdfc94-2e19-40b3-95f4-02cd2109b918"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:44.132686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-56e9105f-8325-40e1-a1bf-f12778e6d97a req-ec9fafad-16db-4389-9089-d4fecd261a8e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:44.135187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-56e9105f-8325-40e1-a1bf-f12778e6d97a req-ec9fafad-16db-4389-9089-d4fecd261a8e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:44.146087 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:44.151000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-56e9105f-8325-40e1-a1bf-f12778e6d97a req-ec9fafad-16db-4389-9089-d4fecd261a8e service nova] Creating event network-vif-plugged:31bdfc94-2e19-40b3-95f4-02cd2109b918 for instance 9f65e809-f39a-49b7-9749-16db6f08c895 on hv-cinder-83735 Jun 16 16:42:44.154472 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c1d95c23-54cb-4731-b4e5-8f46818912bc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.215644 Jun 16 16:42:44.158880 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-56e9105f-8325-40e1-a1bf-f12778e6d97a req-ec9fafad-16db-4389-9089-d4fecd261a8e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046037 Jun 16 16:42:44.160076 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 146/291] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:42:44.164074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 146/292] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:43 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:44.867264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:44.868705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:44.877189 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:44.878118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:44.879453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:44.880119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:44.907368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:45.044360 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:45.052055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc3a7e31-e8e0-41e8-8b2e-0ebafe926bd8 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.191683 Jun 16 16:42:45.052619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 147/293] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:44 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:42:45.171654 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:45.172264 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:45.179356 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:45.179805 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:45.180562 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:45.180982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:45.322181 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:45.333089 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-82773114-0a23-4100-b248-9fe9c26f3221 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.165716 Jun 16 16:42:45.333678 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 147/294] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:45 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:46.070067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:46.071712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:46.078712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:46.079336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:46.080203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:46.080736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:46.217096 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:46.224566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3d250d2e-8616-470a-9ca3-3504a9675e11 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.159072 Jun 16 16:42:46.225343 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 148/295] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:46 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:46.350277 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:46.351008 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:46.358188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:46.358561 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:46.359372 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:46.359767 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:46.605704 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:46.614397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4f6c9c7e-b588-44e3-8a5e-2d4eced97091 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.267869 Jun 16 16:42:46.614876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 148/296] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:46 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:47.242019 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:47.242667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:47.250165 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:47.250460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:47.254810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:47.254810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:47.543483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:47.553908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-287b8453-1c1b-4988-93cc-7c49b2218f96 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.315842 Jun 16 16:42:47.554494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 149/297] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:47 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:47.634164 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:47.634799 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:47.645711 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:47.646339 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:47.647526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:47.648145 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:47.783721 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:47.793671 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d441d364-70a2-42cc-a13b-c39c210946df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.165162 Jun 16 16:42:47.794499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 149/298] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:47 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:48.571069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:48.571777 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:48.578635 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:48.579207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:48.579968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:48.580685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:48.712148 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:48.720193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-545c5707-2ec4-4626-a1f9-30e633562748 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1314 microversion: 2.1 time: 0.153318 Jun 16 16:42:48.720766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 150/299] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:48 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:48.813730 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:48.814284 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:48.823968 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:48.824462 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:48.825542 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:48.825979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:48.962422 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:48.970909 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-62020bfb-e0a7-48c2-8ef9-c7bcbbd020d5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.163177 Jun 16 16:42:48.971515 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 150/300] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:48 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:49.369351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-6cf9bc92-dea3-45ac-812a-3721320846db req-8e76b079-3ee7-42a8-9921-851e2625090b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f57ed7-219e-4057-b423-462f36c3396c", "name": "network-vif-plugged", "status": "completed", "tag": "0da84472-5bcf-4cb0-a569-2a78afef6667"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:49.377826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6cf9bc92-dea3-45ac-812a-3721320846db req-8e76b079-3ee7-42a8-9921-851e2625090b service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:49.378331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6cf9bc92-dea3-45ac-812a-3721320846db req-8e76b079-3ee7-42a8-9921-851e2625090b service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:49.389868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-6cf9bc92-dea3-45ac-812a-3721320846db req-8e76b079-3ee7-42a8-9921-851e2625090b service nova] Creating event network-vif-plugged:0da84472-5bcf-4cb0-a569-2a78afef6667 for instance d6f57ed7-219e-4057-b423-462f36c3396c on hv-cinder-83735 Jun 16 16:42:49.394597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-6cf9bc92-dea3-45ac-812a-3721320846db req-8e76b079-3ee7-42a8-9921-851e2625090b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030026 Jun 16 16:42:49.395245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 151/301] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:49.738340 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:49.739116 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:49.745834 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:49.746275 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:49.747190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:49.748275 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:49.887894 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:49.898784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-78fae93b-5feb-4e97-a07f-38e0fe9f4d8b tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1499 microversion: 2.1 time: 0.164547 Jun 16 16:42:49.899680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 151/302] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:49 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:49.988484 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:49.989365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:49.996344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:49.997000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:49.997897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:49.998408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:50.147814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:50.157735 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-791f0011-6cbf-4c66-9a3b-890b0921b8fe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.172667 Jun 16 16:42:50.158383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 152/303] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:49 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:50.513558 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:50.514059 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:50.521467 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:50.521934 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:50.522924 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:50.523468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:50.552657 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Going to try to terminate instance {{(pid=124103) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:42:50.640952 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-a418ee08-592a-48ec-b7e1-ea413572d971 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "DELETE /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 204 len: 0 microversion: 2.1 time: 0.131411 Jun 16 16:42:50.641642 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 152/304] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:42:50 2022] DELETE /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:42:50.653034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:50.654339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:50.661253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:50.661253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:50.661963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:50.662392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:50.857139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:50.867586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8ff2b858-fb39-4ebf-8b82-264cb1a3b05f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1505 microversion: 2.1 time: 0.220742 Jun 16 16:42:50.868533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 153/305] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:50 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1505 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:51.175812 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:51.176496 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:51.184149 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:51.184953 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:51.185726 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:51.186180 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:51.206299 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=4 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:51.353572 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:51.364585 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-dd785097-67cb-46cf-a4bb-9ac98b8c052b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.193061 Jun 16 16:42:51.365181 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 153/306] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:51 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:51.888875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:51.889520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:51.896540 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:51.897001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:51.897736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:51.898163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:52.042042 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:52.050219 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2deee654-52ae-4f44-9795-0a8b11ac7319 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1505 microversion: 2.1 time: 0.167869 Jun 16 16:42:52.050790 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 154/307] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:51 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:52.387920 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:52.388868 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:52.396420 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:52.396857 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:52.397621 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:52.398041 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:52.418717 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:42:52.544046 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:52.551654 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-341475b9-ef3b-4a40-a3db-fd8b104be1aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.170710 Jun 16 16:42:52.552228 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 154/308] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:52 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:53.072386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:53.072386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:53.078970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:53.080412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:53.081196 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:53.081612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:53.246800 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:53.255040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-230d7194-70c5-48ee-b9f5-6df6cd72c99e tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1505 microversion: 2.1 time: 0.189953 Jun 16 16:42:53.255643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 155/309] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:53 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:53.570452 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:53.571086 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:53.578084 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:53.578532 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:53.579478 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:53.579805 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:53.718438 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:53.726055 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-902fdeac-90cb-4035-bf50-2bfd448ebbe6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.159444 Jun 16 16:42:53.726624 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 155/310] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:53 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:54.272305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:54.273012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:54.279329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:54.279757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:54.281424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:54.281856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:54.429873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:54.438185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c3448b1d-1347-4a32-9cde-91e6f33a24a4 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1505 microversion: 2.1 time: 0.169727 Jun 16 16:42:54.438762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 156/311] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:54 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:54.743818 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:54.745222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:54.752784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:54.753415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:54.754233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:54.754718 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:54.935980 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:54.958596 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e4ec5bf3-cbef-4a28-989e-c8db7025f735 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1322 microversion: 2.1 time: 0.218824 Jun 16 16:42:54.962336 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 156/312] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:54 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:55.361736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-209405e1-9f4d-4100-bb49-17570dd3b89a req-fcd19e07-f63b-433a-8c50-de279990f3f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "518f2a57-94f9-4af5-b7b1-a7e6cb021f18", "name": "network-vif-deleted", "tag": "46f4e2d8-c6ff-4d56-b8e2-93976a2373b4"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:55.371122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-209405e1-9f4d-4100-bb49-17570dd3b89a req-fcd19e07-f63b-433a-8c50-de279990f3f8 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:55.371557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-209405e1-9f4d-4100-bb49-17570dd3b89a req-fcd19e07-f63b-433a-8c50-de279990f3f8 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:55.385376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-209405e1-9f4d-4100-bb49-17570dd3b89a req-fcd19e07-f63b-433a-8c50-de279990f3f8 service nova] Creating event network-vif-deleted:46f4e2d8-c6ff-4d56-b8e2-93976a2373b4 for instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 on hv-cinder-83735 Jun 16 16:42:55.390565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-209405e1-9f4d-4100-bb49-17570dd3b89a req-fcd19e07-f63b-433a-8c50-de279990f3f8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032236 Jun 16 16:42:55.391195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 157/313] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:42:55.455772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:55.456397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:55.462738 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:55.463210 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:55.464213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:55.464672 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:55.548474 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:55.558472 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2fa424ba-6c0d-4f88-afa8-6f379e9854e5 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1463 microversion: 2.1 time: 0.107127 Jun 16 16:42:55.570197 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 157/314] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:55 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1463 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:55.977900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:55.978595 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:55.985887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:55.986319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:55.987066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:55.987524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.131806 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:56.143603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e932afc5-e71c-45b4-b096-7da71634c0eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1515 microversion: 2.1 time: 0.169560 Jun 16 16:42:56.144413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 158/315] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:55 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:56.161023 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:42:56.162502 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:56.168296 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:56.168749 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.169510 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:56.169942 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.194889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.objects.instance [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lazy-loading 'flavor' on Instance uuid d6f57ed7-219e-4057-b423-462f36c3396c {{(pid=124103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:42:56.315316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4d49f2f0-8fe6-4467-a2b8-c6e988d070a6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c/action" status: 200 len: 32 microversion: 2.1 time: 0.158454 Jun 16 16:42:56.315934 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 158/316] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:42:56 2022] POST /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:42:56.324971 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:56.325583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:56.332165 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:56.332608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.333459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:56.334060 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.478431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:56.492280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e0f029c1-cb76-4057-9e56-ed3ab6a55326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.171170 Jun 16 16:42:56.492845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 159/317] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:56 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:56.578789 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:56.579526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:56.586312 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:56.586839 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.587709 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:56.588176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.623801 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:56.624496 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:56.625082 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.objects.instance [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lazy-loading 'fault' on Instance uuid 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 {{(pid=124103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:42:56.722463 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9aced17fa4848ecb0d5be31b87e1e5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7df664c6311a4aefb792aa792ebc17fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:56.730946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d08879f5-367b-4621-a64d-d031406fa443 tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 200 len: 1304 microversion: 2.1 time: 0.157091 Jun 16 16:42:56.732241 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 159/318] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:56 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:57.510627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:57.511257 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:57.518601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:57.519082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:57.519984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:57.520402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:57.652908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:57.665322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-520a007f-aff1-462f-94a0-4ddb1f40fd58 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.158610 Jun 16 16:42:57.666148 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 160/319] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:57 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:57.753292 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:57.754149 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] [instance: 518f2a57-94f9-4af5-b7b1-a7e6cb021f18] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:57.763196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:57.763678 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:57.764607 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:57.765098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:57.779697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] HTTP exception thrown: Instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 could not be found. Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Request method failure captured: Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: request: GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 HTTP/1.1 Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept: application/json Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept-Encoding: identity Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Connection: close Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Length: 0 Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Type: application/json Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Host: 10.222.0.74 Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Openstack-System-Scope: None Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: User-Agent: python-urllib3/1.26.9 Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Auth-Token: gAAAAABiq11BQiUcpkwk4C93n3FQw7tljduBOeWykS9ijD9GpG3UNNqTq_WUN4OUoRN11OMe6A5A0jjQ0UQNG7TKMg23qLLMNquE60tJcLTHPkbYEOHIaD7W76wwJfJrjuvyT4VG91Zl35w4z5qmzltJtzRKSjNRxwPq9ttHiCiLFo47QNaLaJo Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Id: None Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Name: None Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Identity-Status: Confirmed Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Is-Admin-Project: True Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Id: default Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Name: Default Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Id: 7df664c6311a4aefb792aa792ebc17fa Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Name: tempest-VolumesActionsTest-501518164 Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Role: reader,member Jun 16 16:42:57.781371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Roles: reader,member Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_7df664c6311a4aefb792aa792ebc17fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant: tempest-VolumesActionsTest-501518164 Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Id: 7df664c6311a4aefb792aa792ebc17fa Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Name: tempest-VolumesActionsTest-501518164 Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User: tempest-VolumesActionsTest-501518164-project Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Id: default Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Name: Default Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Id: f9aced17fa4848ecb0d5be31b87e1e5a Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Name: tempest-VolumesActionsTest-501518164-project Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: method: > Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: exception: Instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 could not be found. Jun 16 16:42:57.782945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: action_args: {'id': '518f2a57-94f9-4af5-b7b1-a7e6cb021f18'} Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 could not be found. Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:42:57.783779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 could not be found. Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 could not be found. Jun 16 16:42:57.784945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:42:57.785969 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] Returning 404 to user: Instance 518f2a57-94f9-4af5-b7b1-a7e6cb021f18 could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:42:57.785969 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e9191edd-4bb2-473f-8a39-f917fd09ca9f tempest-VolumesActionsTest-501518164 tempest-VolumesActionsTest-501518164-project] 10.222.0.74 "GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18" status: 404 len: 111 microversion: 2.1 time: 0.036730 Jun 16 16:42:57.785969 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 160/320] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:57 2022] GET /compute/v2.1/servers/518f2a57-94f9-4af5-b7b1-a7e6cb021f18 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:42:58.687547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:58.688136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:58.694923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:58.695430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:58.696187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:58.696611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:58.845543 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:42:58.853447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a4a7a14d-e658-4343-aa7d-ce18190b5b57 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.171300 Jun 16 16:42:58.854156 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 161/321] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:58 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:42:59.870341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:42:59.870937 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:42:59.879222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:59.879677 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:42:59.880475 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:42:59.880933 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:00.021536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:00.029604 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e803e303-90bd-48df-b99e-3c7afe74e054 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.163313 Jun 16 16:43:00.030140 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 161/322] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:42:59 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:01.049927 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:01.050622 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:01.058232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:01.058745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:01.059662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:01.060158 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:01.196021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:01.203621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cf812900-3be6-45af-b08b-16f4e6058b1b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.158815 Jun 16 16:43:01.204192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 162/323] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:01 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:02.224867 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:02.226012 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:02.236416 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:02.236802 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:02.237569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:02.238001 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:02.386765 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:02.395558 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b3c54df3-c812-45f1-8e2e-34e5ccff9c3b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.178005 Jun 16 16:43:02.396104 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 162/324] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:02 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:03.422308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:03.423242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:03.434024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:03.434778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:03.436083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:03.437215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:03.583601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:03.591389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d05d318f-dc8f-4f01-b7b6-be1be95d4a0e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.176605 Jun 16 16:43:03.591955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 163/325] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:03 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:04.610522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:04.611146 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:04.618178 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:04.618617 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:04.619414 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:04.619841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:04.778200 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:04.790924 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0ba995b6-4e79-46fe-b774-4f3ddc9c3418 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.185343 Jun 16 16:43:04.791724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 163/326] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:04 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:05.808238 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:05.808856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:05.815547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:05.815991 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:05.816748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:05.817173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:05.955948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:05.963869 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a3491fa1-807b-43de-9bb7-d0e8bc761a37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.159536 Jun 16 16:43:05.964452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 164/327] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:05 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:06.984788 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:06.985536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:06.993164 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:06.993669 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:06.994439 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:06.994849 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:07.130468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:07.142796 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-04883e04-8a47-4d95-879b-d688557331dc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.164331 Jun 16 16:43:07.143775 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 164/328] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:06 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:08.169326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:08.170160 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:08.181221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:08.181963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:08.183285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:08.184002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:08.190081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:08.321582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:08.330879 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-50c506a9-b38a-43d7-9925-028840459f84 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.168169 Jun 16 16:43:08.331460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 165/329] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:08 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:09.348721 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:09.349335 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:09.356400 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:09.356837 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:09.357590 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:09.358030 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:09.497756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:09.506375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-72763c23-7b5d-452c-8095-f9d5b10fcc6a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.161574 Jun 16 16:43:09.506946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 165/330] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:09 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:10.528843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:10.529413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:10.531340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=48 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:10.538013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:10.538510 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:10.539517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:10.539922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:10.680001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:10.688031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dab4addc-9820-416d-b584-55d5f2660eb4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.162993 Jun 16 16:43:10.688591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 166/331] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:10 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:11.705787 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:11.706397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:11.713578 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:11.714019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:11.714776 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:11.715241 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:11.852048 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:11.859992 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-16ad83fb-3a63-413c-9603-e5100c1bf8f3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.158225 Jun 16 16:43:11.860561 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 166/332] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:11 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:12.884121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:12.885372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:12.895352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:12.896245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:12.896913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:12.897322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:13.037288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:13.045174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d41ddae1-cb5f-452e-87db-9bd2faac8a05 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.168232 Jun 16 16:43:13.045750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 167/333] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:12 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:14.068495 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:14.069088 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:14.071849 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:14.081361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:14.082237 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:14.084188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:14.084827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:14.236326 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:14.244213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-887ebb54-d997-40a6-a35c-7282d7092fda tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.182025 Jun 16 16:43:14.245010 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 167/334] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:14 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:15.262298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:15.262868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:15.269901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:15.270342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:15.271125 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:15.271574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:15.621051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:15.632719 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e2cbd35d-73c9-43be-8e51-6345d51d993c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.375072 Jun 16 16:43:15.633652 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 168/335] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:15 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:16.656374 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:16.657145 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:16.667984 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:16.668552 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:16.669730 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:16.670279 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:16.819938 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:16.827831 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e0a357b9-b57f-4eae-a9bc-c5331a972cf2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.178514 Jun 16 16:43:16.828401 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 168/336] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:16 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:17.845192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:17.845787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:17.852316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:17.852765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:17.853524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:17.853950 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:17.986733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:17.998003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-211adf65-ff5d-44ff-9a32-73d4574db922 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.156575 Jun 16 16:43:17.998661 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 169/337] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:17 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:19.019665 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:19.020645 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:19.028426 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:19.028867 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:19.029625 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:19.030051 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:19.049222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:19.173310 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:19.181005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8eeac3e9-2b22-4889-ae3b-65d9b1c9c18d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.168122 Jun 16 16:43:19.181542 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 169/338] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:19 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:20.200241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:20.200871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:20.207453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:20.207906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:20.208672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:20.209099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:20.347729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:20.355913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-93d3494c-f177-434f-90a9-db5b713301f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.159562 Jun 16 16:43:20.356473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 170/339] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:20 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:21.378773 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:21.379660 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:21.391408 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:21.392221 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:21.393907 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:21.394102 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:21.536326 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:21.544522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-24ff28ac-41fe-401a-a181-554e530ab078 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.172210 Jun 16 16:43:21.545129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 170/340] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:21 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:22.564604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:22.565219 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:22.571818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:22.572261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:22.573024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:22.573453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:22.709028 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:22.717550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-32cba73b-adad-47b6-9434-fe03dded1e12 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.156941 Jun 16 16:43:22.718182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 171/341] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:22 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:23.738236 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:23.739109 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:23.747088 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:23.747539 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:23.748293 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:23.748723 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:23.881880 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:23.890198 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-12192b7e-0b41-4b08-bf36-11400a4d4c21 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.158697 Jun 16 16:43:23.890823 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 171/342] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:23 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:24.909483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:24.910286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:24.918690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:24.919164 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:24.919965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:24.920392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:25.065872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:25.076781 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0b1263f7-d4d4-48e7-80fa-5cc913cd328b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.172299 Jun 16 16:43:25.077504 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 172/343] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:24 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:26.095883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:26.096494 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:26.104021 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:26.104471 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:26.105238 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:26.105669 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:26.250784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:26.259665 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-aabdd490-396e-44a7-9c39-e82e3f987ce3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.169519 Jun 16 16:43:26.260376 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 172/344] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:26 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:27.278486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:27.279080 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:27.285725 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:27.286171 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:27.286912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:27.287374 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:27.426343 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:27.434886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b6c5428b-cbbe-4213-aacb-454dd1842326 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.160396 Jun 16 16:43:27.435516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 173/345] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:27 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:28.456912 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:28.458677 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:28.466680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:28.467147 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:28.468301 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:28.468946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:28.645400 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:28.655748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-372f49d8-0116-4153-8caa-e16ba9d49e37 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.202705 Jun 16 16:43:28.656498 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 173/346] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:28 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:29.673312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:29.673925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:29.681397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:29.682228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:29.683336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:29.684004 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:29.827181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:29.835082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-beea1031-67a8-4aa5-b267-e037c97437d9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.166013 Jun 16 16:43:29.844621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 174/347] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:29 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:30.854683 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:30.855301 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:30.862211 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:30.862658 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:30.863476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:30.863895 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:31.004893 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:31.017746 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cc2665c8-bf2d-433b-9ff3-6213c0f953c4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.167896 Jun 16 16:43:31.018602 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 174/348] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:30 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:32.036013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:32.036650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:32.043571 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:32.044007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:32.044763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:32.045190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:32.220098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:32.229141 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-58405d99-1028-4a0c-972b-ba2ff44ca350 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.196923 Jun 16 16:43:32.229774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 175/349] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:32 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:33.246061 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:33.246742 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:33.254046 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:33.254812 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:33.255649 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:33.256060 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:33.418954 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:33.429239 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d71de390-61e6-4dc1-8b62-3d085451215e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.186738 Jun 16 16:43:33.443082 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 175/350] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:33 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:34.459647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:34.460985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:34.468258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:34.469169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:34.470436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:34.470944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:34.624835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:34.635183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d454c0d7-158d-4e89-bf79-55f072991959 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.189780 Jun 16 16:43:34.645341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 176/351] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:34 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:35.654302 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:35.655019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:35.662375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:35.662873 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:35.663686 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:35.664617 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:35.848213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:35.857227 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5724ea14-3996-4219-809b-9571902b5133 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.207958 Jun 16 16:43:35.860832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 176/352] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:35 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:36.878112 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:36.879643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:36.889446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:36.890073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:36.891385 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:36.892000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:37.064089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:37.075335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e12b3899-91b8-4607-86d2-a8410f65046a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.200189 Jun 16 16:43:37.075939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 177/353] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:36 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:38.093027 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:38.094285 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:38.100730 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:38.102022 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:38.102957 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:38.103412 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:38.267907 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:38.276896 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3b2e43fb-4693-4459-8eb5-ede9290f3c4d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.187769 Jun 16 16:43:38.277930 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 177/354] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:38 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:39.294300 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:39.295211 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:39.306846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:39.307429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:39.308337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:39.308840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:39.311999 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=77 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:39.461997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:39.473491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e2d8930c-6182-42d5-80aa-afe796427104 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.182992 Jun 16 16:43:39.474114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 178/355] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:39 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:40.495165 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:40.495864 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:40.504885 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:40.505493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:40.506263 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:40.506680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:40.680137 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:40.688905 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fa274547-0baf-4edb-bc70-34e6af166a95 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.198744 Jun 16 16:43:40.689864 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 178/356] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:40 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:41.706890 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:41.707537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:41.709522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=26 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:41.716443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:41.716962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:41.718249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:41.719164 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:41.984513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:41.998012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c104e83d-abcb-4548-8c81-087c12ea16b9 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.294687 Jun 16 16:43:41.999297 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 179/357] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:41 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:43.019198 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:43.019738 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:43.027268 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:43.028081 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:43.029144 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:43.029778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:43.230946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:43.238543 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9348825f-a1f6-4ce9-9d5d-abc270411a18 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.225480 Jun 16 16:43:43.239129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 179/358] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:43 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:44.256381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:44.257760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:44.266594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:44.267288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:44.268128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:44.268629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:44.413059 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:44.422547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ccbcad45-53eb-46a8-87ac-8150857b8d6f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1521 microversion: 2.1 time: 0.170165 Jun 16 16:43:44.423322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 180/359] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:44 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:45.440647 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:45.441273 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:45.444003 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=26 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:45.449450 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:45.449886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:45.450703 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:45.451407 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:45.585283 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:45.595290 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8e770c6c-4b86-4e11-acc4-a077d81b92ee tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1501 microversion: 2.1 time: 0.158423 Jun 16 16:43:45.596081 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 180/360] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:45 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:45.612114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:45.612750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:45.619016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:45.619659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:45.620417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:45.620847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:45.759027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:45.768231 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a72cfc92-92f8-4eb4-ba9e-9edc17519242 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1515 microversion: 2.1 time: 0.160068 Jun 16 16:43:45.768821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 181/361] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:45 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:48.259521 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:43:48.260695 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:48.270770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:48.270770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:48.271022 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:48.271385 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:48.294810 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.objects.instance [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lazy-loading 'flavor' on Instance uuid 9f65e809-f39a-49b7-9749-16db6f08c895 {{(pid=124103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:43:48.366661 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-39038c6b-d2f2-4591-ba05-bc810b4e6527 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895/action" status: 200 len: 32 microversion: 2.1 time: 0.111604 Jun 16 16:43:48.367340 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 181/362] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:43:48 2022] POST /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:43:48.376615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:48.377237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:48.383799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:48.384888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:48.385892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:48.386324 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:48.530331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:48.556607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0cdf3692-702f-460e-aac2-8be65079dcde tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.183753 Jun 16 16:43:48.559551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 182/363] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:48 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:49.577594 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:49.578293 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:49.584537 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:49.585222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:49.585991 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:49.586581 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:49.590979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:43:49.691305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1430792247", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1503021758", "security_groups": [{"name": "tempest-secgroup-smoke-1583293890"}], "networks": [{"uuid": "34ba5a40-21a8-4510-b11a-a0ece7ca7259"}], "block_device_mapping_v2": [{"uuid": "0f8af9ef-6034-47b3-bb82-bc341f4a1c07", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:43:49.787510 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:49.799689 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-92624228-9148-41db-a243-56072f951259 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.226487 Jun 16 16:43:49.802816 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 182/364] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:49 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:49.854487 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] validate_networks() for [('34ba5a40-21a8-4510-b11a-a0ece7ca7259', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:43:50.287035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:43:50.287973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:43:50.288830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:43:50.289632 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:43:50.290362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:43:50.300343 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:50.300852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:50.301555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:50.301981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:50.323077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Getting quotas for project c099988d7bdc415ab2f206cbe567e77b. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:43:50.327031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Getting quotas for user a47eeee1d19f4deb9402314872f7ba30 and project c099988d7bdc415ab2f206cbe567e77b. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:43:50.389475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:43:50.391665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f8af9ef-6034-47b3-bb82-bc341f4a1c07',volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:43:50.531891 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d27a385c-c7b5-4b26-a434-99127cc98c70 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.844645 Jun 16 16:43:50.533132 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 183/365] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:43:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:43:50.542753 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-385a0d5e-77b6-430e-a193-ae87651b616b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:50.549237 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-385a0d5e-77b6-430e-a193-ae87651b616b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:50.608786 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-385a0d5e-77b6-430e-a193-ae87651b616b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:50.616104 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-385a0d5e-77b6-430e-a193-ae87651b616b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1089 microversion: 2.1 time: 0.077111 Jun 16 16:43:50.617131 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 183/366] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:50 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:50.821407 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:50.822110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:50.829385 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:50.829978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:50.830872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:50.831393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:50.984224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:50.994258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-92cb7a29-9412-4502-bb1a-d450fd2f2de1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.177022 Jun 16 16:43:50.994847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 184/367] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:50 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:51.637764 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:51.638415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:51.646329 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:51.646768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:51.647661 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:51.648178 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:51.720801 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:51.734336 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-be16642e-daae-431b-801b-ba14ce699f8d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1187 microversion: 2.1 time: 0.103767 Jun 16 16:43:51.734975 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 184/368] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:51 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1187 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:52.013285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:52.014164 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:52.021426 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:52.021995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:52.022858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:52.023393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:52.176345 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:52.184837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3994b12e-8964-415e-9736-9a97882022d1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.176443 Jun 16 16:43:52.185585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 185/369] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:52 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:52.754401 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:52.755353 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:52.763401 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:52.764040 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:52.764882 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:52.765458 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:53.032439 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:53.050580 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ffecae86-028c-4e1e-a94a-76a4548e0bc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1273 microversion: 2.1 time: 0.298132 Jun 16 16:43:53.060774 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 185/370] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:52 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:53.202858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:53.204441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:53.212803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:53.213488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:53.214494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:53.215074 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:53.363368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:53.371932 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e8c945bd-d64f-4a15-a05a-1d29e38d6c52 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.173677 Jun 16 16:43:53.372526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 186/371] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:53 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:53.749459 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-8c93237e-50a8-43cf-93df-844fe0aa35a6 req-87ff5eaa-8f0e-4239-9e26-ccf34c6b8282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102aa75e-21d3-415e-9a04-d44e46ca9308", "tag": "67748224-b4d4-4324-99dd-41ee8f120ef2"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:43:53.764697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-8c93237e-50a8-43cf-93df-844fe0aa35a6 req-87ff5eaa-8f0e-4239-9e26-ccf34c6b8282 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:53.765390 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-8c93237e-50a8-43cf-93df-844fe0aa35a6 req-87ff5eaa-8f0e-4239-9e26-ccf34c6b8282 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:53.780786 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-8c93237e-50a8-43cf-93df-844fe0aa35a6 req-87ff5eaa-8f0e-4239-9e26-ccf34c6b8282 service nova] Creating event network-changed:67748224-b4d4-4324-99dd-41ee8f120ef2 for instance 102aa75e-21d3-415e-9a04-d44e46ca9308 on hv-cinder-83735 Jun 16 16:43:53.797387 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-8c93237e-50a8-43cf-93df-844fe0aa35a6 req-87ff5eaa-8f0e-4239-9e26-ccf34c6b8282 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054294 Jun 16 16:43:53.798038 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 186/372] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:43:54.068423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:54.069033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:54.075721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:54.076177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:54.076939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:54.077365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:54.214173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:54.222436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7f7f993e-f74f-429d-b048-84db4c944fc9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.158116 Jun 16 16:43:54.223025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 187/373] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:54 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:54.391128 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:54.391723 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:54.398839 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:54.399324 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:54.400076 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:54.400498 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:54.550474 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:54.561688 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6471c600-6243-489f-ad97-c59a076f1c3a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.175037 Jun 16 16:43:54.562342 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 187/374] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:54 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:55.240079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:55.240689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:55.247395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:55.247839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:55.248607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:55.249034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:55.406655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:55.418643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c5caca8d-430d-47e8-817a-c13974be3bd7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.182445 Jun 16 16:43:55.419775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 188/375] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:55 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:55.580054 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:55.586994 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:55.587483 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:55.588252 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:55.588683 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:55.726517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:55.734168 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-dcb5ca91-e57b-4fbe-a45c-99dbf7c0147b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.158684 Jun 16 16:43:55.734734 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 188/376] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:55 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:56.441610 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:56.442182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:56.448689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:56.449137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:56.450303 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:56.451367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:56.599075 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:56.606801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-39cda5e5-e2de-490e-a6cc-424522d538b4 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.169195 Jun 16 16:43:56.607395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 189/377] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:56 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:56.751465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:56.752083 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:56.759277 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:56.760036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:56.760940 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:56.761371 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:56.903602 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:56.911473 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-50ea96b3-4bbb-4b8b-b361-ee177ccc8eb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.164138 Jun 16 16:43:56.912054 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 189/378] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:56 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:57.624641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:57.625254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:57.632832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:57.633320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:57.634188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:57.635018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:57.776646 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:57.785138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-331dccae-a253-47ab-a62a-4decaa606e0c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.165051 Jun 16 16:43:57.785722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 190/379] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:57 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:57.932770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:57.933670 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:57.942133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:57.942593 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:57.943402 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:57.943840 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:58.092749 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:58.100717 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fc0b8eb2-3ee2-4004-8df0-c1f8b86cc62d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.174356 Jun 16 16:43:58.101295 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 190/380] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:57 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:58.802617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:58.803144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:58.809496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:58.809941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:58.810707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:58.811150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:58.955974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:58.963733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f3772725-df00-4cc2-a926-e307fdc322eb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.165155 Jun 16 16:43:58.964309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 191/381] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:58 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:59.119590 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:59.120135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:59.127886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:59.128375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:59.129201 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:59.129655 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:59.283877 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:43:59.291909 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fad6b85b-9695-49e5-a19a-254edc7b9cbd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.176820 Jun 16 16:43:59.292524 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 191/382] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:59 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:43:59.984012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:43:59.984639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:43:59.991774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:59.992218 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:43:59.993046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:43:59.993467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:00.135900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:00.143913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5f0072a6-2fa4-4e0c-bc4d-66f0f33202d0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.166008 Jun 16 16:44:00.144424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 192/383] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:43:59 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:00.314559 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:00.315197 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:00.322374 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:00.322818 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:00.323627 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:00.324060 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:00.479085 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:00.488061 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5e266d29-232c-422e-bc56-f306593cd1c1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.179601 Jun 16 16:44:00.488637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 192/384] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:00 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:01.160884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:01.161434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:01.163296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:01.163953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=6 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:01.170827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:01.171278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:01.172029 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:01.172497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:01.312259 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:01.320339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-424e69b1-c012-4a99-aa9c-1d43a49c8950 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.163703 Jun 16 16:44:01.320923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 193/385] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:01 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:01.506148 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:01.506760 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:01.508792 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:01.515213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:01.515670 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:01.516655 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:01.517307 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:01.654679 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:01.662717 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-71f7ebc7-589d-4838-9ba3-6beab4f2f4aa tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.160591 Jun 16 16:44:01.663327 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 193/386] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:01 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:01.897015 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:44:01.897334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Thu Jun 16 16:44:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:44:02.341046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:02.342024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:02.350148 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:02.350594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:02.351390 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:02.351815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:02.489853 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:02.500707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ec86003c-39a4-44c5-88ad-2908bef015d6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.165620 Jun 16 16:44:02.501433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 194/387] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:02 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:02.684104 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:02.685131 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:02.697255 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:02.697988 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:02.699296 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:02.700008 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:02.841903 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:02.850272 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3a0bc5f6-5a2a-4173-ae94-d0c41cb1a3cc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.172657 Jun 16 16:44:02.850877 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 194/388] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:02 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:03.522485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:03.523222 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:03.530115 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:03.530577 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:03.531418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:03.531852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:03.548816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:03.741701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:03.755350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b8cad445-b81a-4fa6-beae-9263c8f1a9fd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.236462 Jun 16 16:44:03.756383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 195/389] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:03 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:03.868677 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:03.869443 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:03.877810 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:03.878282 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:03.879325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:03.879836 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:04.022885 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:04.031600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-93fe5e6e-fe76-4175-9c18-14336624bf4e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.166805 Jun 16 16:44:04.032520 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 195/390] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:03 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:04.773534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:04.774134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:04.782488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:04.782938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:04.783751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:04.784180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:05.003289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:05.012480 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-36df9d13-b0d9-435d-8482-cb442e21eb54 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.242823 Jun 16 16:44:05.013099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 196/391] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:04 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:05.050618 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:05.051323 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:05.058630 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:05.059098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:05.060498 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:05.060607 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:05.331399 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:05.339651 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8107f3f3-719a-4a07-ab3f-d4525c7d0040 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.294107 Jun 16 16:44:05.340355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 196/392] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:05 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:06.029453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:06.030119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:06.037888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:06.038330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:06.039352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:06.039786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:06.204545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:06.213673 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-15c12f2d-9133-4ca3-9af7-b12145d745e2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.188052 Jun 16 16:44:06.214417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 197/393] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:06 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:06.356657 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:06.357293 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:06.364082 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:06.364528 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:06.365420 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:06.365987 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:06.493628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:06.501900 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-067ea6bb-1576-4c89-95e9-016b87c77016 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.149154 Jun 16 16:44:06.502481 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 197/394] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:06 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:07.231399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:07.232008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:07.238979 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:07.239463 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:07.240226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:07.240654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:07.388078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:07.395797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f4d5dd42-8cd7-4fcc-8e46-900f1e2ec457 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.168438 Jun 16 16:44:07.396372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 198/395] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:07 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:07.520193 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:07.520794 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:07.527652 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:07.528091 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:07.528850 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:07.529276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:07.662650 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:07.670433 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-37f0c95e-f535-4766-b0c0-241bf7415940 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.154193 Jun 16 16:44:07.670933 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 198/396] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:07 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:08.413840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:08.414413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:08.421809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:08.422661 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:08.423708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:08.424351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:08.502836 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1860722671", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "networks": [{"uuid": "8dbef14f-ece8-4358-aa70-26ffc281d9d8"}]}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:08.564173 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.network.neutron [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] validate_networks() for [('8dbef14f-ece8-4358-aa70-26ffc281d9d8', None, None, None, None, None)] {{(pid=124103) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:44:08.569639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:08.577685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9b8e4b0f-3028-4f06-8cb8-042b5c5b9955 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.167750 Jun 16 16:44:08.578282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 199/397] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:08 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:08.687294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:08.687807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:08.694640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:08.695145 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:08.695909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:08.696339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:08.836564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:08.846513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a5552069-d08b-40b8-864e-0b857674f15b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.163092 Jun 16 16:44:08.847804 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 200/398] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:08 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:08.917096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Flavor limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:44:08.917572 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Image limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:44:08.918254 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Flavor pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:44:08.918893 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Image pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:44:08.920154 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:44:08.933377 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:08.933799 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:08.934961 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:08.935538 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:08.960442 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Getting quotas for project eb9beb4baa2b41808ba9ffa5f233ae48. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:44:08.968281 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Getting quotas for user 797350f034d24e7580beeb67e6693a53 and project eb9beb4baa2b41808ba9ffa5f233ae48. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:44:08.980985 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Going to run 1 instances... {{(pid=124103) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:44:08.983313 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:44:09.030307 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-01791e09-c539-4801-a51e-e96edc408fe0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531942 Jun 16 16:44:09.034964 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 199/399] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:44:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:44:09.041767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-936c6d8e-dd5a-4012-b7b2-f16ebda010a5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:09.042371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-936c6d8e-dd5a-4012-b7b2-f16ebda010a5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:09.096077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-936c6d8e-dd5a-4012-b7b2-f16ebda010a5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:09.103302 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-936c6d8e-dd5a-4012-b7b2-f16ebda010a5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1219 microversion: 2.1 time: 0.065367 Jun 16 16:44:09.103964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 201/400] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:09 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:09.596999 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:09.597600 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:09.604175 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:09.604620 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:09.605374 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:09.605795 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:09.748654 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:09.756126 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5a6091ff-1036-4e0c-b3b2-bc2732f3444a tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.164981 Jun 16 16:44:09.756697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 200/401] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:09 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:09.859845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-65181737-14d7-4689-9374-2b4c4c8e46d6 req-42009e0c-7d02-4019-bcca-33394a463cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102aa75e-21d3-415e-9a04-d44e46ca9308", "name": "network-vif-plugged", "status": "completed", "tag": "67748224-b4d4-4324-99dd-41ee8f120ef2"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:09.864164 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:09.865134 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:09.868299 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-65181737-14d7-4689-9374-2b4c4c8e46d6 req-42009e0c-7d02-4019-bcca-33394a463cb8 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:09.868747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-65181737-14d7-4689-9374-2b4c4c8e46d6 req-42009e0c-7d02-4019-bcca-33394a463cb8 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:09.872957 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:09.873521 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:09.874380 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:09.874897 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:09.879767 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:09.880799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-65181737-14d7-4689-9374-2b4c4c8e46d6 req-42009e0c-7d02-4019-bcca-33394a463cb8 service nova] Creating event network-vif-plugged:67748224-b4d4-4324-99dd-41ee8f120ef2 for instance 102aa75e-21d3-415e-9a04-d44e46ca9308 on hv-cinder-83735 Jun 16 16:44:09.886429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-65181737-14d7-4689-9374-2b4c4c8e46d6 req-42009e0c-7d02-4019-bcca-33394a463cb8 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030416 Jun 16 16:44:09.887044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 202/402] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:10.007151 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:10.015076 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b8ad17e5-c6e4-422f-8971-fbb1b818f3e6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.154882 Jun 16 16:44:10.015640 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 201/403] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:09 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:10.122075 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:10.122675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:10.129839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:10.130275 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:10.131023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:10.131495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:10.194761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:10.202473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8386353d-7f69-4e19-91ca-a23efabbb7ac tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1215 microversion: 2.1 time: 0.084819 Jun 16 16:44:10.203035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 203/404] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:10 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:10.778043 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:10.779362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:10.789948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:10.790573 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:10.791916 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:10.792638 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:10.932803 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:10.941372 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d12ad2b2-f13a-44db-aeb3-d9e287d59857 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.169880 Jun 16 16:44:10.941987 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 202/405] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:10 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:11.037051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:11.038393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:11.045077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:11.045758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:11.046708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:11.047310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:11.186144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:11.194586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ddbe5b02-650e-458b-b4f6-8b0c1d639e6d tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.162109 Jun 16 16:44:11.195381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 204/406] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:11 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:11.219895 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:11.220503 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:11.226710 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:11.227183 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:11.227921 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:11.228358 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:11.291750 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:11.299925 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1e168aa1-b8ca-4244-bc1f-e988e94335c4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1279 microversion: 2.1 time: 0.083974 Jun 16 16:44:11.300509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 203/407] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:11 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1279 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:11.962738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:11.963784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:11.966901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:11.973977 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:11.974415 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:11.975202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:11.975628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.130230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:12.138470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-60e077fc-feef-4363-9130-6b9746fa8d30 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.182302 Jun 16 16:44:12.139140 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 205/408] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:11 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:12.212034 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:12.212633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:12.218779 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.219148 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.219891 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.220337 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.317169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:12.317784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:12.323974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.324481 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.325243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.325676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.353230 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:12.362026 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1d4f40f0-5330-4b2e-b832-83b0410f52c0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1501 microversion: 2.1 time: 0.154145 Jun 16 16:44:12.362617 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 204/409] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:12 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:12.378512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "226dd2e6-5c0c-48b4-a046-4b2c9235621e"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:12.379661 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:12.386308 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.386758 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.387569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.388003 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.389008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:12.397459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8f154651-b298-4f94-8099-e5e60893fd46 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1277 microversion: 2.1 time: 0.084157 Jun 16 16:44:12.398250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 206/410] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:12 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:12.411569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] HTTP exception thrown: Cannot 'attach_volume' instance 9f65e809-f39a-49b7-9749-16db6f08c895 while it is in vm_state rescued Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Request method failure captured: Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: request: POST /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895/os-volume_attachments HTTP/1.1 Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept: application/json Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept-Encoding: identity Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Connection: close Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Length: 74 Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Type: application/json Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Host: 10.222.0.74 Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Openstack-System-Scope: None Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: User-Agent: python-urllib3/1.26.9 Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Auth-Token: gAAAAABiq11ro5b6A7FX6ganUFkpAtzCii9mMuj67uU_EJNeKXyOVPEi11CdokpdBemuXsxHJ3EWXeF6Gk6i83UtOmjUgKcNggIs7XNblR-5bgNopCBBFauzxp28j6cQ1iAIDY97oyTWK_pk6Wim5GNajqAEYXr3_6QO1M8H2BAoUD6g3UGqsMo Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Id: None Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Name: None Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Identity-Status: Confirmed Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Is-Admin-Project: True Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Id: default Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Name: Default Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Role: reader,member Jun 16 16:44:12.413260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Roles: reader,member Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Id: default Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Name: Default Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Id: 86f1f2722c5c4da59fd83036ce1700e1 Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Name: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {"volumeAttachment": {"volumeId": "226dd2e6-5c0c-48b4-a046-4b2c9235621e"}} Jun 16 16:44:12.414740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: method: > Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: exception: Cannot 'attach_volume' instance 9f65e809-f39a-49b7-9749-16db6f08c895 while it is in vm_state rescued Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: action_args: {'server_id': '9f65e809-f39a-49b7-9749-16db6f08c895', 'body': {'volumeAttachment': {'volumeId': '226dd2e6-5c0c-48b4-a046-4b2c9235621e'}}} Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9f65e809-f39a-49b7-9749-16db6f08c895 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:44:12.415636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9f65e809-f39a-49b7-9749-16db6f08c895 while it is in vm_state rescued Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:44:12.416778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:44:12.417859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:44:12.417859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:44:12.417859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9f65e809-f39a-49b7-9749-16db6f08c895 while it is in vm_state rescued Jun 16 16:44:12.417859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:44:12.417859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Returning 409 to user: Cannot 'attach_volume' instance 9f65e809-f39a-49b7-9749-16db6f08c895 while it is in vm_state rescued {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:44:12.417859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7c787bd0-67d7-49ac-8b55-691bf390e5f6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040244 Jun 16 16:44:12.417859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 205/411] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:44:12 2022] POST /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 16:44:12.424185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-17a2be2a-6188-4d2a-ae57-dad4aa8e5dc0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:12.424714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-17a2be2a-6188-4d2a-ae57-dad4aa8e5dc0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:12.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-17a2be2a-6188-4d2a-ae57-dad4aa8e5dc0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.431383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-17a2be2a-6188-4d2a-ae57-dad4aa8e5dc0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.432147 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-17a2be2a-6188-4d2a-ae57-dad4aa8e5dc0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.432581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-17a2be2a-6188-4d2a-ae57-dad4aa8e5dc0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.505626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-17a2be2a-6188-4d2a-ae57-dad4aa8e5dc0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895/action" status: 202 len: 0 microversion: 2.1 time: 0.085690 Jun 16 16:44:12.506233 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 207/412] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:44:12 2022] POST /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:44:12.515460 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:12.516253 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:12.522922 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.523472 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.524233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:12.524657 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:12.670907 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:12.683525 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ae2a0e25-672f-438c-85da-592ff9e4dd33 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1509 microversion: 2.1 time: 0.172028 Jun 16 16:44:12.684367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 206/413] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:12 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:44:13.155452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:13.156326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:13.162931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:13.163604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:13.164793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:13.165210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:13.305894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:13.314334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a2cfa4d7-45f8-4b9f-b89d-84ecb7cbde78 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1261 microversion: 2.1 time: 0.163071 Jun 16 16:44:13.315629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 208/414] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:13 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:13.414232 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:13.414948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:13.421618 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:13.422149 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:13.422970 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:13.423484 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:13.703863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:13.705410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:13.711880 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:13.712535 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:13.713439 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:13.714098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:13.741163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:13.752135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-a9bf3367-9d86-4bcb-a08b-a6dbaad2d2e0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1277 microversion: 2.1 time: 0.341775 Jun 16 16:44:13.753096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 207/415] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:13 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1277 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:13.861452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:13.870203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e14b6427-d825-4e2b-a1ad-ec66072b47ef tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1509 microversion: 2.1 time: 0.170573 Jun 16 16:44:13.870780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 209/416] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:13 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:14.334056 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:14.334755 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:14.342205 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.342697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.343637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.344131 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.496172 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:14.504696 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9b42f0eb-e6c8-4319-baf7-9292d8f26608 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1445 microversion: 2.1 time: 0.175611 Jun 16 16:44:14.505250 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 208/417] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:14 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:14.521853 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:14.522459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:14.530426 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.530871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.531778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.536289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.686081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:14.694242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d72e6079-3e05-4ee1-af56-bef26b5ecbea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1445 microversion: 2.1 time: 0.176273 Jun 16 16:44:14.694814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 210/418] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:14 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1445 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:14.769721 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:14.770384 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:14.776871 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.777047 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.777778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.778210 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.888225 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:14.889082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:14.895805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.896249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.897153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:14.897564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:14.990565 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:14.998879 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f38e7466-4c54-4bec-89ea-4f2a82f593ee tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.233027 Jun 16 16:44:15.000526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 209/419] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:14 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:15.114140 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:15.122260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5f1424cc-3438-47d8-9103-c1a800dc88cb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1509 microversion: 2.1 time: 0.238594 Jun 16 16:44:15.122851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 211/420] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:14 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:15.274001 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-1e481283-b9d5-4fa1-b773-e4a872658748 req-1357e779-8d49-43d2-929d-0592ea7d8720 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1140af8d-a67d-493c-b64b-e080382c24d2", "tag": "259e7573-44bb-4530-8d24-d8885ff5963c"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:15.283411 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-1e481283-b9d5-4fa1-b773-e4a872658748 req-1357e779-8d49-43d2-929d-0592ea7d8720 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:15.283855 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-1e481283-b9d5-4fa1-b773-e4a872658748 req-1357e779-8d49-43d2-929d-0592ea7d8720 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:15.296318 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-1e481283-b9d5-4fa1-b773-e4a872658748 req-1357e779-8d49-43d2-929d-0592ea7d8720 service nova] Creating event network-changed:259e7573-44bb-4530-8d24-d8885ff5963c for instance 1140af8d-a67d-493c-b64b-e080382c24d2 on hv-cinder-83735 Jun 16 16:44:15.301907 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-1e481283-b9d5-4fa1-b773-e4a872658748 req-1357e779-8d49-43d2-929d-0592ea7d8720 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031864 Jun 16 16:44:15.303190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 210/421] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:16.017918 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:16.018518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:16.025212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:16.025672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:16.026488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:16.026916 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:16.142011 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:16.142811 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:16.145048 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:16.151495 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:16.152012 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:16.152756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:16.153469 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:16.241692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:16.244193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:16.253016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-90bee468-52b5-465a-aa95-5d18aab9e77a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.239420 Jun 16 16:44:16.253828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 212/422] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:16 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:16.306160 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:16.314447 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e81e5685-3d4e-4d73-b62e-5b466baf097e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1509 microversion: 2.1 time: 0.177573 Jun 16 16:44:16.315033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 211/423] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:16 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1509 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:16.861314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-81f0a510-d01f-45ed-bcdb-6a11450b7ea1 req-22e1c1c6-991d-4175-892e-a470b2573fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102aa75e-21d3-415e-9a04-d44e46ca9308", "tag": "67748224-b4d4-4324-99dd-41ee8f120ef2"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:16.870049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-81f0a510-d01f-45ed-bcdb-6a11450b7ea1 req-22e1c1c6-991d-4175-892e-a470b2573fbe service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:16.870481 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-81f0a510-d01f-45ed-bcdb-6a11450b7ea1 req-22e1c1c6-991d-4175-892e-a470b2573fbe service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:16.881895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-81f0a510-d01f-45ed-bcdb-6a11450b7ea1 req-22e1c1c6-991d-4175-892e-a470b2573fbe service nova] Creating event network-changed:67748224-b4d4-4324-99dd-41ee8f120ef2 for instance 102aa75e-21d3-415e-9a04-d44e46ca9308 on hv-cinder-83735 Jun 16 16:44:16.887215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-81f0a510-d01f-45ed-bcdb-6a11450b7ea1 req-22e1c1c6-991d-4175-892e-a470b2573fbe service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030047 Jun 16 16:44:16.887798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 213/424] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:17.271301 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:17.272058 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:17.279320 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:17.279735 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:17.280819 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:17.281444 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:17.332273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:17.333104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:17.339823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:17.340323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:17.341070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:17.342473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:17.423539 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:17.432176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cffbc6bb-e2c1-4533-a441-be52e0a900d2 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.165884 Jun 16 16:44:17.433377 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 212/425] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:17 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:17.482006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:17.490096 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8b9a9edc-0f22-4e37-af40-c83104d524cd tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1509 microversion: 2.1 time: 0.162222 Jun 16 16:44:17.490661 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 214/426] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:17 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:18.450835 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:18.451441 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:18.458447 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:18.458916 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:18.459703 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:18.460133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:18.507679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:18.508235 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:18.514551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:18.514991 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:18.515770 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:18.516190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:18.601272 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:18.608947 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4023af0f-a587-4c9e-acad-bf13d749a73f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.162901 Jun 16 16:44:18.609520 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 213/427] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:18 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:18.690371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:18.698345 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8d9892dd-481e-464a-bcb8-27b7c5cb02df tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1509 microversion: 2.1 time: 0.194691 Jun 16 16:44:18.699146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 215/428] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:18 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:19.626395 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:19.627077 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:19.629058 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:19.629723 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=6 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:19.637404 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:19.637842 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:19.638614 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:19.639043 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:19.716743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:19.718069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:19.724733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:19.727858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:19.728609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:19.729590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:19.730213 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:19.879856 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:19.893334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:19.898136 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4001cf6f-208d-43f0-b457-0427f6a3a92a tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.275930 Jun 16 16:44:19.902556 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7890e976-e08a-4103-a721-d329f20b085c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1515 microversion: 2.1 time: 0.189765 Jun 16 16:44:19.903243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 214/429] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:19 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:19.920064 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 216/430] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:19 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:20.922710 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:20.923253 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:20.933190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:20.933872 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:20.935128 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:20.935782 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:21.081475 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:21.089135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9f0b4c6e-65b1-4785-af6e-e45e8debf559 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.172454 Jun 16 16:44:21.089987 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 215/431] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:20 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:22.107389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:22.107960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:22.115435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:22.115875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:22.116640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:22.117079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:22.259026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:22.267300 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6dca5705-1fe5-43a7-90df-9dbb7cf3ea53 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.163856 Jun 16 16:44:22.267927 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 217/432] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:22 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:22.301282 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-02f1e204-b159-41c5-a97c-412c795fb714 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'create', calling method: .version_select at 0x7fe5f8b46af0>, body: {"keypair": {"name": "tempest-keypair-304364425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeZisr7J+cbs4ChsG6tZcUH4pFT3+r5EsSemBknLBcLi7fLafUzL+EQKM6tRmuV0qO0LxBXqgn+tmcKTP5aMq4bUS/gJjSdkoft9DWBh49GDXaywkjNAnPSDROZ+kiNtg=="}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:22.316664 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-02f1e204-b159-41c5-a97c-412c795fb714 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'key_pairs'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:44:22.321557 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-02f1e204-b159-41c5-a97c-412c795fb714 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for user 86f1f2722c5c4da59fd83036ce1700e1 and project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'key_pairs'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:44:22.345228 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-02f1e204-b159-41c5-a97c-412c795fb714 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048083 Jun 16 16:44:22.345883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 216/433] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:44:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:23.285981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:23.287693 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:23.294185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:23.294646 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:23.295447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:23.295850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:23.433403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:23.441350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-aa0bc29a-8b31-4478-9b1e-1d1cd1902b1c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.160122 Jun 16 16:44:23.442077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 218/434] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:23 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:23.734350 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1665888964", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8ebf5a0f-51e6-4c75-979d-1bb269777efc"}], "security_groups": [{"name": "tempest-securitygroup--236208595"}], "key_name": "tempest-keypair-304364425", "user_data": "}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:23.840741 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.network.neutron [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] validate_networks() for [('8ebf5a0f-51e6-4c75-979d-1bb269777efc', None, None, None, None, None)] {{(pid=124103) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:44:24.231476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Flavor limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:44:24.232196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Image limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:44:24.232971 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Flavor pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:44:24.233639 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Image pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:44:24.234270 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:44:24.245040 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:24.245479 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:24.246267 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:24.246697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:24.265953 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:44:24.271182 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Getting quotas for user 86f1f2722c5c4da59fd83036ce1700e1 and project 0907423ad5f14bf9a0680c9cdb78c995. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:44:24.282972 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Going to run 1 instances... {{(pid=124103) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:44:24.285331 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:44:24.335142 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-da457123-bf0e-4a28-83e8-662ad2e8182c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.605761 Jun 16 16:44:24.335828 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 217/435] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:44:23 2022] POST /compute/v2.1/servers => generated 408 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:44:24.346255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d69da317-4ad1-4acb-8275-e555106f594a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:24.346859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d69da317-4ad1-4acb-8275-e555106f594a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:24.400387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d69da317-4ad1-4acb-8275-e555106f594a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:24.407272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d69da317-4ad1-4acb-8275-e555106f594a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1245 microversion: 2.1 time: 0.065006 Jun 16 16:44:24.407846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 219/436] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:24 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1245 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:24.457768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:24.458408 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:24.465126 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:24.465824 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:24.466451 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:24.466819 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:24.605270 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:24.614879 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cda569f5-9f7f-42e9-a693-e4151234c336 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.160829 Jun 16 16:44:24.615960 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 218/437] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:24 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:25.432223 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:25.433425 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:25.443264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:25.443737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:25.444498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:25.444930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:25.511079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:25.520396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cdfb1efa-6658-443b-b0fc-8acd044e3ce8 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1249 microversion: 2.1 time: 0.097075 Jun 16 16:44:25.520636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 220/438] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:25 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1249 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:25.636778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:25.637562 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:25.647222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:25.647656 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:25.648415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:25.648832 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:25.785487 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:25.794176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2c91557d-5665-4e22-9b4e-6785b4e55976 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.164354 Jun 16 16:44:25.794753 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 219/439] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:25 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:26.539835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:26.541034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:26.547517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:26.548170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:26.551208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:26.551654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:26.617215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:26.625240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ec307693-5d04-4f6f-97f5-9c7236941376 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1249 microversion: 2.1 time: 0.092286 Jun 16 16:44:26.625784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 221/440] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:26 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:26.816226 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:26.817160 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:26.825645 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:26.826091 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:26.826848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:26.827316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:26.842420 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:26.964507 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:26.976173 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4d607a46-0aa8-4252-9cf1-2a1d6ded1186 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.166600 Jun 16 16:44:26.976953 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 220/441] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:26 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:27.645604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:27.646208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:27.653092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:27.653538 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:27.654299 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:27.654729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:27.729736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:27.738347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-60fc994a-b7f1-499f-a6ce-8c229ef1ab49 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1249 microversion: 2.1 time: 0.096729 Jun 16 16:44:27.738822 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 222/442] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:27 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:27.998281 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:27.998848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:28.006792 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:28.007258 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:28.008020 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:28.008513 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:28.152490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:28.160690 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fd82c041-9436-4f87-8110-9021cb45f738 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.166546 Jun 16 16:44:28.161355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 221/443] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:27 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:28.755789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:28.756390 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:28.763343 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:28.763785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:28.764542 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:28.764937 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:28.830198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:28.839292 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-33162c7a-8ff4-4b64-a9c1-ae7f0f505682 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1303 microversion: 2.1 time: 0.087426 Jun 16 16:44:28.839963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 223/444] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:28 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:29.178328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:29.178935 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:29.186225 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:29.186668 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:29.187499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:29.187923 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:29.420328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:29.429489 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-deaaeaeb-004c-4727-aa6e-66ffc5be8e74 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.255162 Jun 16 16:44:29.432658 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 222/445] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:29 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:29.465837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-ca6d61ba-89cb-44d7-b801-769987bdf04a req-783fbd76-88be-4ddb-89dd-226d81320dee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1140af8d-a67d-493c-b64b-e080382c24d2", "name": "network-vif-plugged", "status": "completed", "tag": "259e7573-44bb-4530-8d24-d8885ff5963c"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:29.475021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-ca6d61ba-89cb-44d7-b801-769987bdf04a req-783fbd76-88be-4ddb-89dd-226d81320dee service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:29.475563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-ca6d61ba-89cb-44d7-b801-769987bdf04a req-783fbd76-88be-4ddb-89dd-226d81320dee service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:29.488939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-ca6d61ba-89cb-44d7-b801-769987bdf04a req-783fbd76-88be-4ddb-89dd-226d81320dee service nova] Creating event network-vif-plugged:259e7573-44bb-4530-8d24-d8885ff5963c for instance 1140af8d-a67d-493c-b64b-e080382c24d2 on hv-cinder-83735 Jun 16 16:44:29.495284 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-ca6d61ba-89cb-44d7-b801-769987bdf04a req-783fbd76-88be-4ddb-89dd-226d81320dee service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033095 Jun 16 16:44:29.496205 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 224/446] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:29.856752 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:29.857261 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:29.863544 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:29.863981 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:29.864748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:29.865178 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:30.089586 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:30.098033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5257ebf3-54f6-42ba-9e59-46affc09adae tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.245873 Jun 16 16:44:30.099098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 223/447] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:29 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:30.244348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-261ffe42-5e67-4ddb-ae49-1dcf45255ce1 req-79eaef07-ac4a-48f9-bd7e-d77c67e19b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76def3bd-d733-4708-adad-1e7e7d17a584", "tag": "368dadc0-6d23-4b91-bc72-2b811bb87380"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:30.253634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-261ffe42-5e67-4ddb-ae49-1dcf45255ce1 req-79eaef07-ac4a-48f9-bd7e-d77c67e19b03 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:30.254443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-261ffe42-5e67-4ddb-ae49-1dcf45255ce1 req-79eaef07-ac4a-48f9-bd7e-d77c67e19b03 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:30.269090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-261ffe42-5e67-4ddb-ae49-1dcf45255ce1 req-79eaef07-ac4a-48f9-bd7e-d77c67e19b03 service nova] Creating event network-changed:368dadc0-6d23-4b91-bc72-2b811bb87380 for instance 76def3bd-d733-4708-adad-1e7e7d17a584 on hv-cinder-83735 Jun 16 16:44:30.274494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-261ffe42-5e67-4ddb-ae49-1dcf45255ce1 req-79eaef07-ac4a-48f9-bd7e-d77c67e19b03 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034506 Jun 16 16:44:30.275330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 225/448] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:30.449599 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:30.450183 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:30.457676 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:30.458270 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:30.459434 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:30.459944 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:30.601527 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:30.611731 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-334ae1f9-0ca8-468a-8ac8-dad230dd0b9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.166250 Jun 16 16:44:30.612340 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 224/449] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:30 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:31.118419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:31.119114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:31.127000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:31.127544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:31.128418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:31.128912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:31.264260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:31.272957 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1a5d3b9f-d3e7-424f-8991-6b8484ba05b4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.159702 Jun 16 16:44:31.273534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 226/450] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:31 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:31.633505 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:31.635096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:31.646062 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:31.646790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:31.648071 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:31.648773 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:31.791632 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:31.799552 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6fb6387d-3df1-4c67-929f-b1870db6b710 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.172468 Jun 16 16:44:31.800195 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 225/451] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:31 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:32.290022 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:32.291084 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:32.297712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:32.298150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:32.298898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:32.299479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:32.432326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:32.440526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-966187f8-f692-42d3-bb53-38321ac1474a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.154518 Jun 16 16:44:32.441133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 227/452] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:32 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:32.819944 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:32.820599 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:32.828118 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:32.828582 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:32.829327 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:32.829761 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:33.265597 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:33.273497 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-a13f5fe2-6d34-4764-83b1-aaa764d110f5 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1319 microversion: 2.1 time: 0.459827 Jun 16 16:44:33.274074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 226/453] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:32 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:33.458041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:33.458593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:33.465275 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:33.465718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:33.466471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:33.466897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:33.605051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:33.612893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4fdf01f9-ea47-4964-b589-0071aa8c7257 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.158843 Jun 16 16:44:33.613501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 228/454] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:33 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:34.291881 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:34.292583 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:34.295314 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:34.296167 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=10 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:34.303714 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:34.304088 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:34.311234 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:34.312426 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:34.453132 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:34.461449 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7b5790fb-2390-413b-ac98-ffb6b1078f24 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1509 microversion: 2.1 time: 0.174084 Jun 16 16:44:34.462021 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 227/455] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:34 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1509 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:34.629670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:34.630286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:34.632322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:34.640601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:34.641053 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:34.641825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:34.642254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:34.782849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:34.791170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c819c31e-73d5-4418-ba90-42b77a269de0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.164837 Jun 16 16:44:34.792010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 229/456] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:34 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:35.808527 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:35.809155 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:35.816020 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:35.816461 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:35.817209 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:35.817634 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:35.969471 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:35.976987 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-480e378e-2c29-4120-9b2c-060424dbdb63 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.172408 Jun 16 16:44:35.977552 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 228/457] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:35 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:36.994495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:36.995603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:37.001917 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:37.002708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:37.003199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:37.003631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:37.144471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:37.152577 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-573ffcd1-40cb-43f2-9c9a-0d185f7d5927 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.161960 Jun 16 16:44:37.153159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 230/458] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:36 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:38.170507 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:38.171250 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:38.179247 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:38.179745 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:38.180625 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:38.181186 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:38.323193 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:38.334195 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e511f7bb-070a-4417-a9e6-26df4333cff7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.167888 Jun 16 16:44:38.335016 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 229/459] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:38 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:39.354830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:39.355493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:39.361947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:39.362401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:39.363169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:39.363591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:39.506112 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:39.514491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-63ad65e1-cd77-4ed3-bfaa-76ce25cd2796 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.164717 Jun 16 16:44:39.515044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 231/460] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:39 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:40.532952 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:40.533547 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:40.542799 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:40.543426 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:40.544256 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:40.544671 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:40.698402 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:40.710101 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-13d09542-193f-4589-aa79-b6691ddb995c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.181457 Jun 16 16:44:40.710844 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 230/461] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:40 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:41.730588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:41.731270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:41.738497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:41.738990 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:41.739863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:41.740339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:41.757797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:41.885351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:41.897772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-76669e0c-305a-4fe9-9095-b59d8858ea5f tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.172549 Jun 16 16:44:41.898565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 232/462] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:41 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:42.916291 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:42.916862 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:42.923767 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:42.924206 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:42.924967 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:42.925387 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:43.065824 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:43.073251 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-1f54aaea-89df-4796-8bd4-49c082b40f90 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.161232 Jun 16 16:44:43.073851 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 231/463] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:42 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:44.090817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:44.091452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:44.093387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=58 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:44.099889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:44.100333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:44.101077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:44.101532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:44.238203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:44.248464 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ca4477f1-9e63-47a1-9489-6592a5275193 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.161212 Jun 16 16:44:44.249286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 233/464] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:44 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:45.267850 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:45.269251 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:45.276889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:45.277650 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:45.278430 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:45.278860 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:45.437800 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:45.445427 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e840e07b-30a9-4898-9442-96058a7a742b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.182333 Jun 16 16:44:45.445995 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 232/465] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:45 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:46.461846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:46.462559 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:46.469761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:46.469761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:46.470403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:46.470819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:46.610747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:46.618247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7b23b9e0-4b20-462d-9122-20279d27f1f1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.160338 Jun 16 16:44:46.618821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 234/466] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:46 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:46.864469 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-b0756181-5e08-4bc5-b8c5-35a6e317321c req-61acbf47-2232-45d1-b52c-f0ca5a1c4a75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76def3bd-d733-4708-adad-1e7e7d17a584", "name": "network-vif-plugged", "status": "completed", "tag": "368dadc0-6d23-4b91-bc72-2b811bb87380"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:46.871304 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:46.878793 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-b0756181-5e08-4bc5-b8c5-35a6e317321c req-61acbf47-2232-45d1-b52c-f0ca5a1c4a75 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:46.880042 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-b0756181-5e08-4bc5-b8c5-35a6e317321c req-61acbf47-2232-45d1-b52c-f0ca5a1c4a75 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:46.892295 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-b0756181-5e08-4bc5-b8c5-35a6e317321c req-61acbf47-2232-45d1-b52c-f0ca5a1c4a75 service nova] Creating event network-vif-plugged:368dadc0-6d23-4b91-bc72-2b811bb87380 for instance 76def3bd-d733-4708-adad-1e7e7d17a584 on hv-cinder-83735 Jun 16 16:44:46.897781 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-b0756181-5e08-4bc5-b8c5-35a6e317321c req-61acbf47-2232-45d1-b52c-f0ca5a1c4a75 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037126 Jun 16 16:44:46.898624 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 233/467] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:47.636456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:47.637150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:47.644012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:47.644456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:47.645184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:47.645644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:47.800024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:47.807978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d4058f07-9c91-40bb-9ffb-0bd154344f78 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.175748 Jun 16 16:44:47.808555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 235/468] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:47 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:48.830316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:48.830995 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:48.838461 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:48.838994 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:48.839789 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:48.840218 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:48.981290 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:48.989821 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e8bfcf71-47f9-4640-a176-18754bf40a9b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.165461 Jun 16 16:44:48.990486 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 234/469] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:48 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:50.012736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:50.013340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:50.021731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:50.022382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:50.023384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:50.023845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:50.165975 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:50.173436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0895d504-e3df-44b7-920f-fc7512222b62 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1370 microversion: 2.1 time: 0.165251 Jun 16 16:44:50.174098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 236/470] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:50 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:51.192036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:51.192881 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:51.202477 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:51.203187 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:51.204337 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:51.204979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:51.341262 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:51.350311 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-62f36ac9-1b18-4a91-97d9-5532492be083 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1563 microversion: 2.1 time: 0.163516 Jun 16 16:44:51.351019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 235/471] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:51 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1563 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:51.369764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-82bb0517-4b04-4d47-b1f4-006094748a86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:51.370305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-82bb0517-4b04-4d47-b1f4-006094748a86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:51.379918 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82bb0517-4b04-4d47-b1f4-006094748a86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:51.380315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82bb0517-4b04-4d47-b1f4-006094748a86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:51.381105 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82bb0517-4b04-4d47-b1f4-006094748a86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:51.381518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82bb0517-4b04-4d47-b1f4-006094748a86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:51.465559 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-82bb0517-4b04-4d47-b1f4-006094748a86 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101717 Jun 16 16:44:51.466183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 237/472] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:44:51 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:52.617645 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-6675fb51-5251-44c8-b2e0-3fdef9839afc req-915efcc4-fe0b-4f08-98cd-4bb07a11209e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76def3bd-d733-4708-adad-1e7e7d17a584", "tag": "368dadc0-6d23-4b91-bc72-2b811bb87380"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:52.630162 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-6675fb51-5251-44c8-b2e0-3fdef9839afc req-915efcc4-fe0b-4f08-98cd-4bb07a11209e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:52.631027 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-6675fb51-5251-44c8-b2e0-3fdef9839afc req-915efcc4-fe0b-4f08-98cd-4bb07a11209e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:52.645992 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-6675fb51-5251-44c8-b2e0-3fdef9839afc req-915efcc4-fe0b-4f08-98cd-4bb07a11209e service nova] Creating event network-changed:368dadc0-6d23-4b91-bc72-2b811bb87380 for instance 76def3bd-d733-4708-adad-1e7e7d17a584 on hv-cinder-83735 Jun 16 16:44:52.651613 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-6675fb51-5251-44c8-b2e0-3fdef9839afc req-915efcc4-fe0b-4f08-98cd-4bb07a11209e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037529 Jun 16 16:44:52.652753 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 236/473] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:55.953721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2104495047", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:56.005895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] validate_networks() for None {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:44:56.304273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:44:56.304684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:44:56.305149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:44:56.305547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:44:56.306091 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:44:56.316658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:56.317100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:56.317883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:56.318315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:56.336361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Getting quotas for project cee83a10226143fb857ff3a24c7bd618. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:44:56.340587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Getting quotas for user 34bd80b8b96244abb71e5de4319fc1d8 and project cee83a10226143fb857ff3a24c7bd618. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:44:56.352154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:44:56.354369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:44:56.405564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cd729204-27b4-4d4e-a058-c5c48e45530f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457478 Jun 16 16:44:56.406199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 238/474] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:44:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:44:56.421233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8b31917c-486d-49ca-915a-0f3597c3b09e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:56.421990 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8b31917c-486d-49ca-915a-0f3597c3b09e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:56.478275 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8b31917c-486d-49ca-915a-0f3597c3b09e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:56.485894 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8b31917c-486d-49ca-915a-0f3597c3b09e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1215 microversion: 2.1 time: 0.073040 Jun 16 16:44:56.486324 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 237/475] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:56 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:57.503646 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:57.504223 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:57.510819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:57.511285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:57.512386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:57.512816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:57.581044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:57.588878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4cb2cdad-3698-4f33-b7ae-432b00fe088d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1267 microversion: 2.1 time: 0.089528 Jun 16 16:44:57.589453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 239/476] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:57 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1267 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:58.606135 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:58.606799 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:58.614564 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:58.615129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:58.615992 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:58.616501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:58.619553 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=92 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:44:58.817176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:44:58.825423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-331047cf-751b-498a-8625-9c8565927ab5 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.223223 Jun 16 16:44:58.826119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 238/477] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:58 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:44:59.455814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-92d0aa51-4be5-41d5-95cd-3eec25cc53cd req-ffa6c8a9-477d-4449-bf0d-41261429d9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a34cf2c0-de65-4d1a-90f7-9deded04aa1c", "tag": "95432b80-2c9e-4729-b52b-35d36b00087d"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:44:59.469439 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-92d0aa51-4be5-41d5-95cd-3eec25cc53cd req-ffa6c8a9-477d-4449-bf0d-41261429d9a1 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:59.469991 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-92d0aa51-4be5-41d5-95cd-3eec25cc53cd req-ffa6c8a9-477d-4449-bf0d-41261429d9a1 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:59.483481 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-92d0aa51-4be5-41d5-95cd-3eec25cc53cd req-ffa6c8a9-477d-4449-bf0d-41261429d9a1 service nova] Creating event network-changed:95432b80-2c9e-4729-b52b-35d36b00087d for instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c on hv-cinder-83735 Jun 16 16:44:59.489168 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-92d0aa51-4be5-41d5-95cd-3eec25cc53cd req-ffa6c8a9-477d-4449-bf0d-41261429d9a1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037173 Jun 16 16:44:59.489782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 240/478] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:44:59.847547 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:44:59.848164 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:44:59.855174 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:59.855641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:59.856411 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:44:59.856908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:44:59.993220 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:00.000951 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9f52d78c-a711-4f08-b3dd-c9cdb0d3120e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.159517 Jun 16 16:45:00.001889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 239/479] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:44:59 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:01.022034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:01.022895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:01.030887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:01.031440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:01.032323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:01.032823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:01.179043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:01.186811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8bb6d77b-e22e-4d78-ad0f-23293fd0abe3 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.170550 Jun 16 16:45:01.187418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 241/480] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:01 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:02.206478 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:02.207379 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:02.216834 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:02.217468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:02.218542 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:02.219196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:02.353970 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:02.363948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-91e276a6-302a-41e4-a8f5-21462ee17527 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.163156 Jun 16 16:45:02.364733 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 240/481] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:02 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:03.380548 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:03.381137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:03.387953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:03.388396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:03.389154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:03.389584 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:03.540870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:03.549727 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a19a7a42-9961-446e-92f7-a3efe1182014 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.173648 Jun 16 16:45:03.550304 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 242/482] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:03 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:04.568885 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:04.569509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:04.576569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:04.577015 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:04.577784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:04.578214 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:04.722358 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:04.730418 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-93b9063e-223e-4697-92a0-32e5015ec209 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.167020 Jun 16 16:45:04.730986 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 241/483] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:04 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:05.751889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:05.752843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:05.759883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:05.760330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:05.761086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:05.761518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:05.899996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:05.908224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-28aae432-25ed-4319-942d-76fe78cc537d tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.163109 Jun 16 16:45:05.908834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 243/484] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:05 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:06.925945 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:06.926674 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:06.929188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:06.934761 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:06.935230 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:06.936005 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:06.936433 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:07.309227 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:07.316994 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0788a11c-bc68-493d-a737-73e1b7523f72 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.395424 Jun 16 16:45:07.317564 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 242/485] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:06 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:07.608869 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1fd482eb-cc25-4a4c-bfe0-f003c67db90b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80ab7008-0e00-4f79-a245-ebeae6b477cb", "device": "/dev/sdb"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:07.611337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1fd482eb-cc25-4a4c-bfe0-f003c67db90b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:07.613997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:07.614661 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=6 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:07.620718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fd482eb-cc25-4a4c-bfe0-f003c67db90b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:07.621154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fd482eb-cc25-4a4c-bfe0-f003c67db90b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:07.621910 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fd482eb-cc25-4a4c-bfe0-f003c67db90b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:07.622335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fd482eb-cc25-4a4c-bfe0-f003c67db90b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:07.922100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1fd482eb-cc25-4a4c-bfe0-f003c67db90b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "POST /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319743 Jun 16 16:45:07.922708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 244/486] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:45:07 2022] POST /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:08.280774 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-dcf16f35-5a49-4ca7-a1a7-5692cb125c86 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:08.282037 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-dcf16f35-5a49-4ca7-a1a7-5692cb125c86 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:08.290002 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcf16f35-5a49-4ca7-a1a7-5692cb125c86 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:08.290423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcf16f35-5a49-4ca7-a1a7-5692cb125c86 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:08.291226 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcf16f35-5a49-4ca7-a1a7-5692cb125c86 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:08.291648 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dcf16f35-5a49-4ca7-a1a7-5692cb125c86 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:08.314490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-dcf16f35-5a49-4ca7-a1a7-5692cb125c86 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/ips" status: 200 len: 150 microversion: 2.1 time: 0.042423 Jun 16 16:45:08.315077 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 243/487] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:45:08 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:08.337165 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:08.337788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:08.344990 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:08.345433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:08.346209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:08.346622 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:08.484387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:08.495082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9ecd9086-c7f7-4a67-a22a-98639b286e33 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.163561 Jun 16 16:45:08.496132 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 245/488] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:08 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:09.250664 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-69653864-1224-4739-8887-0dd3fe71d6ee req-0adec86b-8a32-4eea-8e48-7cb7d5ed58e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34cf2c0-de65-4d1a-90f7-9deded04aa1c", "name": "network-vif-plugged", "status": "completed", "tag": "95432b80-2c9e-4729-b52b-35d36b00087d"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:09.262771 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-69653864-1224-4739-8887-0dd3fe71d6ee req-0adec86b-8a32-4eea-8e48-7cb7d5ed58e1 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:09.263243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-69653864-1224-4739-8887-0dd3fe71d6ee req-0adec86b-8a32-4eea-8e48-7cb7d5ed58e1 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:09.276427 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-69653864-1224-4739-8887-0dd3fe71d6ee req-0adec86b-8a32-4eea-8e48-7cb7d5ed58e1 service nova] Creating event network-vif-plugged:95432b80-2c9e-4729-b52b-35d36b00087d for instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c on hv-cinder-83735 Jun 16 16:45:09.281674 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-69653864-1224-4739-8887-0dd3fe71d6ee req-0adec86b-8a32-4eea-8e48-7cb7d5ed58e1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036611 Jun 16 16:45:09.282591 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 244/489] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:09.512485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:09.513046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:09.519770 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:09.520238 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:09.521000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:09.521423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:09.667850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:09.675924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fde4e672-4921-4424-8abd-423ca6e5f87e tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.167523 Jun 16 16:45:09.676849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 246/490] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:09 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:10.153339 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6e97ef79-f582-4ae7-8a2f-5c487aed2c3b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:10.154057 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6e97ef79-f582-4ae7-8a2f-5c487aed2c3b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:10.164316 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6e97ef79-f582-4ae7-8a2f-5c487aed2c3b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:10.164803 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6e97ef79-f582-4ae7-8a2f-5c487aed2c3b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:10.165838 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6e97ef79-f582-4ae7-8a2f-5c487aed2c3b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:10.166383 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6e97ef79-f582-4ae7-8a2f-5c487aed2c3b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:10.191928 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6e97ef79-f582-4ae7-8a2f-5c487aed2c3b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/ips" status: 200 len: 152 microversion: 2.20 time: 0.045425 Jun 16 16:45:10.192479 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 245/491] 10.222.0.74 () {60 vars in 1288 bytes} [Thu Jun 16 16:45:10 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:45:10.694810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:10.695596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:10.702211 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:10.702658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:10.703531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:10.703924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:10.734848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ca87ba3c-6eea-45cd-8cec-491235f7eb5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c48fac7d-508b-4086-896c-d5c8d5f819e0"}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:10.735912 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-ca87ba3c-6eea-45cd-8cec-491235f7eb5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:10.743041 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ca87ba3c-6eea-45cd-8cec-491235f7eb5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:10.743517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ca87ba3c-6eea-45cd-8cec-491235f7eb5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:10.744247 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ca87ba3c-6eea-45cd-8cec-491235f7eb5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:10.744675 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ca87ba3c-6eea-45cd-8cec-491235f7eb5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:10.838322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:10.845799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1d6b2355-c955-403b-ac5d-516ec5c739b4 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.156651 Jun 16 16:45:10.846359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 247/492] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:10 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:11.116956 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ca87ba3c-6eea-45cd-8cec-491235f7eb5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385740 Jun 16 16:45:11.122064 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 246/493] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:45:10 2022] POST /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:45:11.862709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:11.863793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:11.869918 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:11.870361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:11.871163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:11.871581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:11.874277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:12.017092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:12.025179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5aebdc5f-2b67-4e84-b370-85a9f6a85a04 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1315 microversion: 2.1 time: 0.166415 Jun 16 16:45:12.025744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 248/494] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:11 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:13.047729 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:13.048877 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:13.057529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.058094 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.058839 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.059311 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.198848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:13.206912 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3d9ee3f0-90a8-48b2-97b8-8cf374521262 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1465 microversion: 2.1 time: 0.167194 Jun 16 16:45:13.207524 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 247/495] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:13 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:13.248370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:13.249868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:13.258742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.259341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.260174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.260660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.271524 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:13.272061 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:13.280178 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.280915 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.281648 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.282222 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.288447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:45:13.306526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.objects.instance [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lazy-loading 'flavor' on Instance uuid 0b7f89d4-2837-48f0-854e-4267acb270bb {{(pid=124103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:45:13.366880 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6b3e31c7-4096-4ef8-b377-7edf62371427 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 204 len: 0 microversion: 2.1 time: 0.122419 Jun 16 16:45:13.372135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 249/496] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:45:13 2022] DELETE /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:45:13.378097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:13.378818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:13.385979 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.386428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.387596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.388035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.521278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:13.530497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-789a928e-4998-4769-af06-7206c452d4e1 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1471 microversion: 2.1 time: 0.157073 Jun 16 16:45:13.531537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 250/497] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:13 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1471 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:13.572064 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-451943a1-bea3-4ac3-818b-c1f8f8dd3c6a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/action" status: 202 len: 0 microversion: 2.20 time: 0.304396 Jun 16 16:45:13.572601 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 248/498] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Jun 16 16:45:13 2022] POST /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:45:13.581108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:13.581714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:13.588494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.588929 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.589680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:13.590103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:13.731623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:13.743472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:13.744971 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:13.746133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a5034d61-7143-4809-9103-538bbf5bd0ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.169007 Jun 16 16:45:13.746685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 251/499] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:13 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:14.550820 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:14.551616 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:14.559436 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:14.559881 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:14.560646 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:14.561087 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:14.704608 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:14.714298 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5e440ba6-2b76-42cd-ad5a-b984376ce396 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1471 microversion: 2.1 time: 0.168553 Jun 16 16:45:14.715175 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 249/500] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:14 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:14.770393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:14.770989 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:14.773416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:14.778708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:14.779170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:14.779920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:14.780347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:14.925780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:14.938354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:14.940705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:14.942559 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-97bfd0c0-e7b8-48f1-9c42-73def8148fd4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.175864 Jun 16 16:45:14.943502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 252/501] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:14 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:15.735446 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:15.736794 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:15.747523 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:15.748275 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:15.749529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:15.750247 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:15.889261 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:15.896839 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5cab9ee6-5a0c-499b-9cb6-92c1c727b31f tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1471 microversion: 2.1 time: 0.167917 Jun 16 16:45:15.897883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 250/502] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:15 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1471 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:15.968289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:15.968867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:15.976213 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:15.976688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:15.977441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:15.977868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:16.111807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:16.121012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:16.122514 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:16.123724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-549a5969-7879-4dac-8eee-77d36ec24c19 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.159477 Jun 16 16:45:16.124268 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 253/503] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:15 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:16.919948 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:16.920583 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:16.923077 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=38 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:16.928876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:16.929297 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:16.930072 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:16.930512 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:17.142350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:17.142918 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:17.154233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34bd80b8b96244abb71e5de4319fc1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cee83a10226143fb857ff3a24c7bd618', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:17.161501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:17.161949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:17.162729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:17.163261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:17.163871 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-bd8aca0a-d4d7-40c3-8f16-db069fd23a10 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 200 len: 1471 microversion: 2.1 time: 0.247788 Jun 16 16:45:17.168615 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 251/504] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:16 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 1471 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:17.214753 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-8e654d91-7e1e-4c70-b029-1b73bc4b2951 req-7c8772fb-c2b1-420d-b3e5-dfb82c478dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a34cf2c0-de65-4d1a-90f7-9deded04aa1c", "name": "network-vif-deleted", "tag": "95432b80-2c9e-4729-b52b-35d36b00087d"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:17.223553 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-8e654d91-7e1e-4c70-b029-1b73bc4b2951 req-7c8772fb-c2b1-420d-b3e5-dfb82c478dbd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:17.223991 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-8e654d91-7e1e-4c70-b029-1b73bc4b2951 req-7c8772fb-c2b1-420d-b3e5-dfb82c478dbd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:17.237018 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-8e654d91-7e1e-4c70-b029-1b73bc4b2951 req-7c8772fb-c2b1-420d-b3e5-dfb82c478dbd service nova] Creating event network-vif-deleted:95432b80-2c9e-4729-b52b-35d36b00087d for instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c on hv-cinder-83735 Jun 16 16:45:17.242874 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-8e654d91-7e1e-4c70-b029-1b73bc4b2951 req-7c8772fb-c2b1-420d-b3e5-dfb82c478dbd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Jun 16 16:45:17.244119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 252/505] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:17.333459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:17.342594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:17.344416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:17.345870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4a6f65c5-57b2-4852-85d4-f31ee19b47b7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.207585 Jun 16 16:45:17.346956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 254/506] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:17 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:18.182700 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:18.183470 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] [instance: a34cf2c0-de65-4d1a-90f7-9deded04aa1c] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:18.190759 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:18.191254 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:18.192082 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:18.192535 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:18.207113 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] HTTP exception thrown: Instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c could not be found. Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Request method failure captured: Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: request: GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c HTTP/1.1 Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept: application/json Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept-Encoding: identity Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Connection: close Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Length: 0 Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Type: application/json Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Host: 10.222.0.74 Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Openstack-System-Scope: None Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: User-Agent: python-urllib3/1.26.9 Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Auth-Token: gAAAAABiq14FIUKgyAIC555vzenCvi8rt4olwyZ0vYKFkj8kx_vlb8fRUoofDltIiLc56Fp_awP0wIxiRRgzySmxq_NhjB9X-EB84Swo5eWH-TegtZwxDB-PpPzjtTLIgJ8OxQUmmBXVeuGUpMJBpSWZWWTyRGeK5UP6j5kDmhZig5GMaeXKpN0 Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Id: None Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Name: None Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Identity-Status: Confirmed Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Is-Admin-Project: True Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Id: default Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Name: Default Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Id: cee83a10226143fb857ff3a24c7bd618 Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Name: tempest-VolumesNegativeTest-2106988481 Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Role: reader,member Jun 16 16:45:18.208889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Roles: reader,member Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/cee83a10226143fb857ff3a24c7bd618"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/cee83a10226143fb857ff3a24c7bd618"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/cee83a10226143fb857ff3a24c7bd618"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_cee83a10226143fb857ff3a24c7bd618"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant: tempest-VolumesNegativeTest-2106988481 Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Id: cee83a10226143fb857ff3a24c7bd618 Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Name: tempest-VolumesNegativeTest-2106988481 Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User: tempest-VolumesNegativeTest-2106988481-project Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Id: default Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Name: Default Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Id: 34bd80b8b96244abb71e5de4319fc1d8 Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Name: tempest-VolumesNegativeTest-2106988481-project Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: method: > Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: exception: Instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c could not be found. Jun 16 16:45:18.210529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: action_args: {'id': 'a34cf2c0-de65-4d1a-90f7-9deded04aa1c'} Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c could not be found. Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:45:18.211341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c could not be found. Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c could not be found. Jun 16 16:45:18.212691 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:18.213986 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] Returning 404 to user: Instance a34cf2c0-de65-4d1a-90f7-9deded04aa1c could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:45:18.213986 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-64b4cf92-a1e5-42cd-8abb-892f28187363 tempest-VolumesNegativeTest-2106988481 tempest-VolumesNegativeTest-2106988481-project] 10.222.0.74 "GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c" status: 404 len: 111 microversion: 2.1 time: 0.032818 Jun 16 16:45:18.213986 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 253/507] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:18 2022] GET /compute/v2.1/servers/a34cf2c0-de65-4d1a-90f7-9deded04aa1c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:45:18.364784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:18.365551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:18.373021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:18.373517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:18.374278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:18.374706 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:18.507417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:18.515774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:18.517264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:18.518410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-58b245cf-2dd1-45fe-a4af-80187879088e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.157721 Jun 16 16:45:18.518965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 255/508] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:18 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:19.536893 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:19.537572 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:19.545134 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:19.545982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:19.547454 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:19.547885 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:19.550862 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:19.696268 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:19.704429 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:19.705922 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:19.707180 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d7486a5f-b5d1-4c7b-8c6a-04296cf99d25 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.174371 Jun 16 16:45:19.707862 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 254/509] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:19 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:20.726740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:20.727404 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:20.734256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:20.734764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:20.735495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:20.735918 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:20.881667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:20.890860 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:20.892787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:20.894014 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-339b6f5a-110d-49a7-8a8d-86be75d9b032 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.172390 Jun 16 16:45:20.898657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 256/510] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:20 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:21.915361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:21.916197 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:21.925770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:21.926425 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:21.927569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:21.928176 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:22.071514 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:22.080544 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:22.082051 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:22.083465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-848ebd45-130d-4111-a318-26e8b89e9767 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.173543 Jun 16 16:45:22.083838 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 255/511] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:21 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:23.101877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:23.102584 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:23.109576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:23.109999 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:23.110788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:23.111315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:23.248944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:23.257045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:23.258660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:23.259963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0864d86d-fe18-409d-a301-1a7331e5f4a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.162085 Jun 16 16:45:23.260558 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 257/512] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:23 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:24.280278 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:24.281853 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:24.288784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:24.289307 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:24.290254 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:24.290734 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:24.444380 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:24.455179 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:24.462288 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:24.463543 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fbcce853-cdb1-4eb3-a85e-0ef2549aac93 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.187424 Jun 16 16:45:24.463994 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 256/513] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:24 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:25.061413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f4711ae4-8565-4a70-9e82-a0efd4b0f911 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: .version_select at 0x7fe5f8c30a60>, body: {"keypair": {"name": "tempest-keypair-2099145403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqnVeQ95x9AFDTVgKfdknIMZFuzLi8isqmTEqCD5QSBek5oR0LdJVKLfpU4Hj0f3njHsixdYzHIhQMBqBs2DNFjf+KGjmbdXo34vhzbGI/Xy2ubuXx9mjPYgPf07ZbETw=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:25.076459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-f4711ae4-8565-4a70-9e82-a0efd4b0f911 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:45:25.080669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-f4711ae4-8565-4a70-9e82-a0efd4b0f911 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:45:25.107845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f4711ae4-8565-4a70-9e82-a0efd4b0f911 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050514 Jun 16 16:45:25.108791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 258/514] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:45:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:25.483406 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:25.484212 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:25.492722 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:25.493154 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:25.493926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:25.496055 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:25.780938 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:25.789457 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:25.790926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:25.792129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-22cd5261-ab17-4162-b471-a22ffa510dd0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.313270 Jun 16 16:45:25.792693 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 257/515] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:25 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:26.788355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1672377377", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e1f0da2-a24e-4041-9def-f84f18fbaf90"}], "security_groups": [{"name": "tempest-securitygroup--2069732897"}], "key_name": "tempest-keypair-2099145403", "user_data": "}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:26.816162 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:26.817870 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:26.833001 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:26.833440 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:26.834724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:26.834724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:26.996170 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:27.004014 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] validate_networks() for [('9e1f0da2-a24e-4041-9def-f84f18fbaf90', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:45:27.006464 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:27.008259 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:27.009601 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0075d258-8ea7-4781-9a83-4381f3a21322 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.202935 Jun 16 16:45:27.010357 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 258/516] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:26 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:45:27.868041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:45:27.868528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:45:27.868934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:45:27.869396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:45:27.870256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:45:27.880684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:27.881128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:27.882228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:27.882869 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:27.903823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:45:27.908434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:45:27.921905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:45:27.924659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:45:27.981246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c5604426-8add-4d11-90a1-2613fe8d8643 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.198833 Jun 16 16:45:27.982488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 259/517] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:45:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:45:27.992790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c125a3e1-8832-41c9-8e6e-bfdfaa47bc5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:27.993531 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c125a3e1-8832-41c9-8e6e-bfdfaa47bc5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:28.029198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:28.029890 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:28.036589 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:28.037110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:28.038127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:28.038766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:28.078750 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c125a3e1-8832-41c9-8e6e-bfdfaa47bc5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:28.086256 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c125a3e1-8832-41c9-8e6e-bfdfaa47bc5b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1242 microversion: 2.1 time: 0.097618 Jun 16 16:45:28.087348 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 259/518] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:27 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1242 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:28.295800 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:28.305183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:28.306702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:28.307959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ab2b99c7-8a93-4507-a217-4b75650b8093 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.283005 Jun 16 16:45:28.308539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 260/519] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:28 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:29.103699 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:29.104305 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:29.115594 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:29.116918 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:29.120476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:29.120927 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:29.208051 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:29.215801 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-0daebc29-9698-48b8-8a9c-16dc1eaa7025 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1294 microversion: 2.1 time: 0.116366 Jun 16 16:45:29.216430 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 260/520] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:29 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1294 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:29.327520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:29.328854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:29.335964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:29.336485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:29.337312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:29.337800 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:29.506713 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:29.518356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:29.520678 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:29.522173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b057ca49-612f-43be-b508-e59d18986dfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.199067 Jun 16 16:45:29.522846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 261/521] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:29 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:30.233984 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:30.234698 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:30.241470 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:30.242028 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:30.242883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:30.243463 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:30.348743 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:30.363620 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-477adc99-bb38-4bc4-bf39-b57ecda78b3e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1300 microversion: 2.1 time: 0.133857 Jun 16 16:45:30.369480 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 261/522] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:30 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1300 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:30.541964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:30.543765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:30.553566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:30.554030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:30.554816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:30.555280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:30.761085 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:30.771964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:30.773734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:30.775154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c3a2412d-a03b-4020-ae22-48da23a600ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.238032 Jun 16 16:45:30.775853 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 262/523] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:30 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:31.382621 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:31.384336 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:31.393056 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:31.394066 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:31.394939 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:31.396093 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:31.682742 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:31.691984 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e7fe8a20-961e-4ccf-a0a6-94d9984d08a5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.314550 Jun 16 16:45:31.695971 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 262/524] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:31 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:31.795519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:31.797801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:31.806357 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:31.807639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:31.809088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:31.810033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:31.998383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:32.007290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:32.009169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:32.010697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-28387c59-15f7-42e1-a56b-6783cadcf5a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.220821 Jun 16 16:45:32.011424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 263/525] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:31 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:32.458830 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-daa1558d-7abc-4ac1-a016-7c381d7c529e req-3fdbf062-668c-4aa1-bfe0-0ae3fc6f3526 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e903d6b-31ee-4c6b-be7b-35b5aeeeb732", "tag": "361eed59-d4cf-441b-9aea-4b05fcc698aa"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:32.470786 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-daa1558d-7abc-4ac1-a016-7c381d7c529e req-3fdbf062-668c-4aa1-bfe0-0ae3fc6f3526 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:32.471260 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-daa1558d-7abc-4ac1-a016-7c381d7c529e req-3fdbf062-668c-4aa1-bfe0-0ae3fc6f3526 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:32.485330 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-daa1558d-7abc-4ac1-a016-7c381d7c529e req-3fdbf062-668c-4aa1-bfe0-0ae3fc6f3526 service nova] Creating event network-changed:361eed59-d4cf-441b-9aea-4b05fcc698aa for instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 on hv-cinder-83735 Jun 16 16:45:32.491029 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-daa1558d-7abc-4ac1-a016-7c381d7c529e req-3fdbf062-668c-4aa1-bfe0-0ae3fc6f3526 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036170 Jun 16 16:45:32.492239 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 263/526] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:32.712834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:32.713516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:32.721198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:32.721708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:32.722871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:32.723573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:33.032185 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:33.032886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:33.046362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:33.046939 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:33.049957 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:33.054601 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:33.306837 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:33.317147 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:33.321657 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:33.323964 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-29b00a5e-9bf0-48df-a204-2df506d2c2bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.297853 Jun 16 16:45:33.335295 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 264/527] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:33 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:33.399791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:33.409003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:33.411984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-506c90fb-dbed-4a45-81db-e4fd523e3105 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.703275 Jun 16 16:45:33.412787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 264/528] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:32 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:34.343581 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:34.344239 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:34.351577 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:34.352294 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:34.353451 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:34.354151 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:34.432266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:34.436661 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:34.457309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:34.457803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:34.458615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:34.459038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:34.628648 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:34.639396 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:34.641199 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:34.644064 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5028cc91-191f-465f-827f-005163321b07 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.306073 Jun 16 16:45:34.652019 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 265/529] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:34 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:34.949505 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:34.957885 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a56e710e-6e5a-4443-b4db-0fdb9a9ddb94 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.532514 Jun 16 16:45:34.959232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 265/530] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:34 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:35.675557 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:35.676250 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:35.683957 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:35.684404 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:35.685375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:35.686037 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:35.905340 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:35.913675 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:35.915505 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:35.916680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cbd6aec8-1da0-44b5-b776-37cab6f54b4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.250702 Jun 16 16:45:35.917225 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 266/531] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:35 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:35.975162 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:35.976194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:35.983675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:35.984087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:35.985071 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:35.985500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:36.172789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:36.182062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7dd84723-8f96-48c0-9be6-67bf5eef6e2a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.210859 Jun 16 16:45:36.211305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 266/532] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:35 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:36.936676 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:36.937452 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:36.944892 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:36.945333 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:36.946098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:36.946526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:37.213216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:37.213845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:37.236149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:37.236600 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:37.237377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:37.238006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:37.427286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:37.436739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cedd5432-9bbd-4947-8434-2fd307fa9889 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.228455 Jun 16 16:45:37.438045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 267/533] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:37 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:45:37.550195 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:37.559411 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:37.561494 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:37.563413 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d3ffcd76-ee39-4a0e-a500-451b02a4a7fa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.631569 Jun 16 16:45:37.564473 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 267/534] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:36 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:37.940381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:37.941806 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=10 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:38.049821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e9d5c9d9-e0cf-4aa0-a2c4-917e711ff411 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Action: 'create', calling method: .version_select at 0x7fe5f8be1dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-863924614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCIkPWv/Rao7Ngf8c5duxHc6B9yl0Ztqx+IlR6mwO94ipdI4i2hcGSC/rrYw+XbH+l0Pmx8SxscCa0cKjvfrjwEI+7Zc3Hvhy2oX2Q9Cos/2VPhtDJnufLOaHwt05WM+w=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:38.064246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-e9d5c9d9-e0cf-4aa0-a2c4-917e711ff411 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:45:38.068076 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-e9d5c9d9-e0cf-4aa0-a2c4-917e711ff411 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for user d162fcafed2c4ae099a5786cceb84891 and project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:45:38.092256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e9d5c9d9-e0cf-4aa0-a2c4-917e711ff411 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.156397 Jun 16 16:45:38.092813 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 268/535] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:45:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:45:38.457489 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:38.458090 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:38.461805 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=2 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:38.468963 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:38.469495 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:38.470419 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:38.470869 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:38.585045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:38.587545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:38.602165 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:38.602917 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:38.604632 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:38.605291 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:38.625355 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:38.636463 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d5fbfb87-02f4-4ef8-bf55-6fad05fa0e0b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.185277 Jun 16 16:45:38.638358 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 268/536] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:38 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:45:38.754099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:38.762428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:38.764448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:38.765750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-005bcc2b-337b-487b-b7f1-037544b2b519 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.187061 Jun 16 16:45:38.766314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 269/537] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:38 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:39.655022 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:39.655756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:39.662501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:39.662970 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:39.663836 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:39.664265 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:39.785103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:39.786466 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:39.793549 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:39.793993 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:39.794955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:39.795402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:39.803996 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:39.812835 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-dde461ce-da5c-42ba-92bb-a045f56a0708 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.163052 Jun 16 16:45:39.813424 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 269/538] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:39 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:39.960150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:39.969782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:39.971411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:39.972660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9bed2ef0-fa92-429c-8b59-dae9e3eaa88a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.191541 Jun 16 16:45:39.973524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 270/539] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:39 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:40.952837 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:40.953587 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:40.960233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:40.960669 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:40.961464 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:40.961891 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:40.991982 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:41.003241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:41.011008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:41.011510 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:41.012302 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:41.012743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:41.105711 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:41.113765 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-237e7763-d1f3-4bf0-8863-569b4f915f50 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.287527 Jun 16 16:45:41.114360 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 270/540] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:40 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:41.159506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:41.171287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:41.173556 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:41.175186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ea9286e3-5652-4c07-8322-6e304abcb8ba tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.186852 Jun 16 16:45:41.176022 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 271/541] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:40 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:45:41.287237 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:41.287729 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:41.294413 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:41.294983 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:41.295774 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:41.296199 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:41.458616 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.objects.instance [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lazy-loading 'services' on Instance uuid 1140af8d-a67d-493c-b64b-e080382c24d2 {{(pid=124103) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:45:41.579888 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:41.594202 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-58e49139-4e48-4f02-be46-b48949e17829 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2/os-volume_attachments/80ab7008-0e00-4f79-a245-ebeae6b477cb" status: 202 len: 0 microversion: 2.1 time: 0.311126 Jun 16 16:45:41.594800 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 271/542] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:45:41 2022] DELETE /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2/os-volume_attachments/80ab7008-0e00-4f79-a245-ebeae6b477cb => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:45:42.132288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:42.132909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:42.140671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:42.141120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:42.141885 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:42.142319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:42.197859 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:42.198723 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:42.205332 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:42.205778 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:42.206541 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:42.206969 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:42.289274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:42.297894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7df6722d-07de-43c4-b197-903cbc88c358 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.169532 Jun 16 16:45:42.298476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 272/543] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:42 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:42.343899 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:42.352028 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:42.353628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:42.354886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-823ad1aa-c65a-4aeb-bd1a-6a335386f584 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.162270 Jun 16 16:45:42.355561 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 272/544] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:42 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:45:43.316780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:43.317344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:43.324547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:43.324986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:43.325754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:43.326175 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:43.373809 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:43.374417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:43.381637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:43.382146 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:43.382941 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:43.383415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:43.473819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:43.483702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3891da94-c364-4670-9a18-571083f8c89f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.171435 Jun 16 16:45:43.484842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 273/545] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:43 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:43.530597 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:43.539643 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:43.541475 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:43.542669 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-67a2bcaf-38a5-428d-90cc-a15bf7c1c8ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.172966 Jun 16 16:45:43.543529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 273/546] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:43 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:44.501139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:44.501716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:44.509150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:44.509597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:44.510369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:44.510820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:44.654552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:44.662642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a65ce45f-84a1-46cf-bcb3-01837e48ddfa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.165437 Jun 16 16:45:44.663620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 274/547] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:44 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:44.677524 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:44.678257 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:44.684289 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:44.684731 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:44.685637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:44.686063 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:44.829107 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:44.844253 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:44.853097 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:44.854650 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2de32ce2-61e9-40f2-82fa-6c228355e272 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.296346 Jun 16 16:45:44.867199 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 274/548] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:44 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:45.680867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:45.681466 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:45.683957 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=5 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:45.690310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:45.690804 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:45.691614 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:45.692045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:45.842051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:45.850511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a5b90153-ff13-4db8-bfeb-70de654c79dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.174047 Jun 16 16:45:45.851077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 275/549] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:45 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:45.876772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:45.877952 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:45.885818 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:45.886652 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:45.887624 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:45.888952 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:46.047007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-08a91f20-c606-4a1d-8944-c7ff3d4cfbaf req-5adc9fa5-e7a2-4e6c-856a-077b759bd876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e903d6b-31ee-4c6b-be7b-35b5aeeeb732", "name": "network-vif-plugged", "status": "completed", "tag": "361eed59-d4cf-441b-9aea-4b05fcc698aa"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:46.050748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:46.056386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-08a91f20-c606-4a1d-8944-c7ff3d4cfbaf req-5adc9fa5-e7a2-4e6c-856a-077b759bd876 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:46.057108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-08a91f20-c606-4a1d-8944-c7ff3d4cfbaf req-5adc9fa5-e7a2-4e6c-856a-077b759bd876 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:46.059538 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:46.060890 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:46.062133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-477e1595-ca63-438a-9ac5-b313cadfe518 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.191949 Jun 16 16:45:46.062683 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 275/550] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:45 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:46.082556 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-08a91f20-c606-4a1d-8944-c7ff3d4cfbaf req-5adc9fa5-e7a2-4e6c-856a-077b759bd876 service nova] Creating event network-vif-plugged:361eed59-d4cf-441b-9aea-4b05fcc698aa for instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 on hv-cinder-83735 Jun 16 16:45:46.094479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-08a91f20-c606-4a1d-8944-c7ff3d4cfbaf req-5adc9fa5-e7a2-4e6c-856a-077b759bd876 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051634 Jun 16 16:45:46.095580 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 276/551] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:45:46.868874 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:46.869602 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:46.876075 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:46.876522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:46.877297 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:46.877835 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:46.982862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:46.983511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:46.989642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:46.990278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:46.991018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:46.991766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:47.024875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:45:47.028393 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:47.036169 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-82932fdc-c29e-4dd1-90f7-f5177e3fc07a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.172096 Jun 16 16:45:47.036799 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 276/552] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:46 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:47.082637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:47.083451 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:47.085471 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=54 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:47.091476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:47.091922 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:47.092689 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:47.093117 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:47.112764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9d0a8020-dbd7-431e-95f3-4b7e06ccbfea tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "DELETE /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 204 len: 0 microversion: 2.1 time: 0.134316 Jun 16 16:45:47.113842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 277/553] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:45:46 2022] DELETE /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:45:47.122613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:47.123467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:47.130094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:47.130538 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:47.131355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:47.131786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:47.235707 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:47.244370 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:47.245981 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:47.247188 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-175084b4-25ea-4414-b50c-a95c00e30f87 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.168972 Jun 16 16:45:47.248043 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 277/554] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:47 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:47.274714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:47.283699 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ede8083e-3d78-42dd-b76e-6bcce09f4e11 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1515 microversion: 2.1 time: 0.165537 Jun 16 16:45:47.284278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 278/555] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:47 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:48.055574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:48.056368 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:48.064985 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:48.065569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:48.066555 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:48.067152 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:48.206652 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:48.214368 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4d5e5eee-0b41-4624-9da8-9694627b1c99 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.163906 Jun 16 16:45:48.214928 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 278/556] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:48 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:48.266530 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:48.267321 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:48.269959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:48.275769 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:48.276232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:48.277094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:48.277533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:48.300895 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:48.301492 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:48.308758 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:48.309193 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:48.310164 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:48.310747 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:48.423794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:48.432370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:48.434075 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:48.435268 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-77a1da18-503d-46cf-9734-e7b7a4869a83 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.173279 Jun 16 16:45:48.436021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 279/557] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:48 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:48.451697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:48.461926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2b6d8a53-e3d4-40aa-b1df-218e5bebe7bc tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1515 microversion: 2.1 time: 0.164701 Jun 16 16:45:48.462752 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 279/558] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:48 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:45:49.232965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:49.233596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:49.240301 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:49.240746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:49.241509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:49.241923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:49.393820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:49.405406 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-958e1b2f-0c87-4ff2-b926-483faf25d6f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.177546 Jun 16 16:45:49.405981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 280/559] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:49 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:49.454253 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:49.454909 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:49.462249 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:49.462687 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:49.463497 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:49.463927 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:49.482057 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:49.482688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:49.489290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:49.489727 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:49.490481 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:49.490897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:49.506339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:49.600695 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:49.609668 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:49.611201 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:49.612499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-82391ff4-6f93-45ef-95d0-fc1d79cdc460 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.162556 Jun 16 16:45:49.613068 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 280/560] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:49 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:49.629612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:49.639875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-da377e36-1d19-4ded-b8ef-e71ffe603b1b tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1515 microversion: 2.1 time: 0.161704 Jun 16 16:45:49.640386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 281/561] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:49 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:49.916737 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-115f9fab-745f-4f19-9172-9c3695ed85ab req-6c7c869d-3df8-4a43-9bd9-fbdb8d35eb09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f89d4-2837-48f0-854e-4267acb270bb", "name": "network-vif-plugged", "status": "completed", "tag": "6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:49.928522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-115f9fab-745f-4f19-9172-9c3695ed85ab req-6c7c869d-3df8-4a43-9bd9-fbdb8d35eb09 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:49.929148 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-115f9fab-745f-4f19-9172-9c3695ed85ab req-6c7c869d-3df8-4a43-9bd9-fbdb8d35eb09 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:49.941151 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-115f9fab-745f-4f19-9172-9c3695ed85ab req-6c7c869d-3df8-4a43-9bd9-fbdb8d35eb09 service nova] Creating event network-vif-plugged:6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d for instance 0b7f89d4-2837-48f0-854e-4267acb270bb on hv-cinder-83735 Jun 16 16:45:49.946373 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-115f9fab-745f-4f19-9172-9c3695ed85ab req-6c7c869d-3df8-4a43-9bd9-fbdb8d35eb09 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034396 Jun 16 16:45:49.946959 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 281/562] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:50.427273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:50.427815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:50.435214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:50.435651 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:50.436397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:50.436815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:50.586083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:50.594487 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fc67ebeb-d21e-4e0c-8df2-05b1eb0a6bad tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.171101 Jun 16 16:45:50.595224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 282/563] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:50 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:50.631912 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:50.632628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:50.640346 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:50.640782 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:50.641557 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:50.641986 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:50.658401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:50.659670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:50.666291 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:50.666738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:50.668402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:50.668828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:50.808624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:50.816964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1180b725-b57a-4c16-afe6-7e4197cb5bf0 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1515 microversion: 2.1 time: 0.162993 Jun 16 16:45:50.817541 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 283/564] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:50 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:50.870564 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:50.885436 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:50.887210 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:50.888975 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5533e5f8-0c77-40eb-b1c0-f9825d17cfdb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.261540 Jun 16 16:45:50.889417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 282/565] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:50 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:51.137159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-cf5e549c-77d8-48a8-adee-e97f628772d0 req-3ab5042a-0c80-404f-88d6-f41deefb3b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1140af8d-a67d-493c-b64b-e080382c24d2", "name": "network-vif-deleted", "tag": "259e7573-44bb-4530-8d24-d8885ff5963c"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:51.146139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-cf5e549c-77d8-48a8-adee-e97f628772d0 req-3ab5042a-0c80-404f-88d6-f41deefb3b9b service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.146588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-cf5e549c-77d8-48a8-adee-e97f628772d0 req-3ab5042a-0c80-404f-88d6-f41deefb3b9b service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.157881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-cf5e549c-77d8-48a8-adee-e97f628772d0 req-3ab5042a-0c80-404f-88d6-f41deefb3b9b service nova] Creating event network-vif-deleted:259e7573-44bb-4530-8d24-d8885ff5963c for instance 1140af8d-a67d-493c-b64b-e080382c24d2 on hv-cinder-83735 Jun 16 16:45:51.163698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-cf5e549c-77d8-48a8-adee-e97f628772d0 req-3ab5042a-0c80-404f-88d6-f41deefb3b9b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030957 Jun 16 16:45:51.164449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 284/566] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:51.612539 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:51.613274 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:51.619533 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.620036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.621017 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.621701 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.762818 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:51.771440 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e1430b57-ac99-48e2-8e76-78fa4d2dd92c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1368 microversion: 2.1 time: 0.163475 Jun 16 16:45:51.772011 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 283/567] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:51 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:51.836553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:51.837192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:51.844138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.844579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.845328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.845751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.877709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.878152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.878611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lazy-loading 'fault' on Instance uuid 1140af8d-a67d-493c-b64b-e080382c24d2 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:45:51.907990 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:51.908595 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:51.914738 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.915224 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.915980 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:51.916415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:51.923557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:51.930936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b3c367a0-aa6a-467d-a67a-e62644c74456 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 200 len: 1309 microversion: 2.1 time: 0.099243 Jun 16 16:45:51.931555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 285/568] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:51 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:52.051161 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:52.059958 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:52.061455 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:52.062586 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-70dd56c5-f657-4823-8f9a-a6e772280124 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.158578 Jun 16 16:45:52.063195 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 284/569] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:51 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:52.793081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:52.794101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:52.800672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:52.801046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:52.801807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:52.802236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:52.942629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:52.948386 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:52.949221 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 1140af8d-a67d-493c-b64b-e080382c24d2] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:52.950724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-379f54af-b363-4490-a63a-e2398bf2bf0d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1557 microversion: 2.1 time: 0.164477 Jun 16 16:45:52.951325 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 286/570] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:52 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:45:52.956951 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:52.957394 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:52.958151 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:52.958577 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:52.967679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-84f11b39-e4f8-429e-9aef-343f6994fc21 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:52.968246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-84f11b39-e4f8-429e-9aef-343f6994fc21 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:52.973140 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.wsgi [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] HTTP exception thrown: Instance 1140af8d-a67d-493c-b64b-e080382c24d2 could not be found. Jun 16 16:45:52.974513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84f11b39-e4f8-429e-9aef-343f6994fc21 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Request method failure captured: Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: request: GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 HTTP/1.1 Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept: application/json Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Accept-Encoding: identity Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Connection: close Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Length: 0 Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Content-Type: application/json Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Host: 10.222.0.74 Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Openstack-System-Scope: None Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: User-Agent: python-urllib3/1.26.9 Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Auth-Token: gAAAAABiq13VZv8C3BHAc5LQOQoTRXTaPhsmMI-QQLSY-M7ijS_GoKjD9YkAKIgevyEZmfQC3WkztoEwk_vMu7UAvYakSxTBa-H1vgpyKgz2BgT27q7_gCX0LdpN1ggSOZr5KzT6XAggoFDy2Qn95okfDtBFIR5Z43ENRaFEkCe7C1ThWbh31k4 Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Id: None Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Domain-Name: None Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Identity-Status: Confirmed Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Is-Admin-Project: True Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Id: default Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Domain-Name: Default Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Id: eb9beb4baa2b41808ba9ffa5f233ae48 Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1446814356 Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Role: reader,member Jun 16 16:45:52.974827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Roles: reader,member Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant: tempest-VolumesSnapshotTestJSON-1446814356 Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Id: eb9beb4baa2b41808ba9ffa5f233ae48 Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1446814356 Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User: tempest-VolumesSnapshotTestJSON-1446814356-project Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Id: default Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Domain-Name: Default Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Id: 797350f034d24e7580beeb67e6693a53 Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: X-User-Name: tempest-VolumesSnapshotTestJSON-1446814356-project Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: method: > Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: exception: Instance 1140af8d-a67d-493c-b64b-e080382c24d2 could not be found. Jun 16 16:45:52.976405 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: action_args: {'id': '1140af8d-a67d-493c-b64b-e080382c24d2'} Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1140af8d-a67d-493c-b64b-e080382c24d2 could not be found. Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:45:52.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1140af8d-a67d-493c-b64b-e080382c24d2 could not be found. Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1140af8d-a67d-493c-b64b-e080382c24d2 could not be found. Jun 16 16:45:52.979123 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: ERROR nova.api.openstack.wsgi Jun 16 16:45:52.980446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84f11b39-e4f8-429e-9aef-343f6994fc21 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:52.980544 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Returning 404 to user: Instance 1140af8d-a67d-493c-b64b-e080382c24d2 could not be found. {{(pid=124103) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:45:52.980632 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84f11b39-e4f8-429e-9aef-343f6994fc21 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:52.980632 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84f11b39-e4f8-429e-9aef-343f6994fc21 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:52.980788 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2597846c-5035-46a6-8f6f-076dec5dfe77 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2" status: 404 len: 111 microversion: 2.1 time: 0.031927 Jun 16 16:45:52.980788 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 285/571] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:45:52 2022] GET /compute/v2.1/servers/1140af8d-a67d-493c-b64b-e080382c24d2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:45:53.060337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-84f11b39-e4f8-429e-9aef-343f6994fc21 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097153 Jun 16 16:45:53.061087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 287/572] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:45:52 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:45:53.080944 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:53.081698 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:53.087814 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:53.088341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:53.089153 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:53.090292 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:53.225908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:53.234175 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:53.235756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:53.236890 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3e149b55-7cb3-4cfb-8a9c-cfb009a4ac23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.160305 Jun 16 16:45:53.237445 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 286/573] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:53 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:54.019822 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-cb51b8e5-1729-4c2f-bc5d-c79bf85025c7 req-57705f60-14d9-49cc-946c-3478903e9929 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e903d6b-31ee-4c6b-be7b-35b5aeeeb732", "tag": "361eed59-d4cf-441b-9aea-4b05fcc698aa"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:45:54.028266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-cb51b8e5-1729-4c2f-bc5d-c79bf85025c7 req-57705f60-14d9-49cc-946c-3478903e9929 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:54.028704 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-cb51b8e5-1729-4c2f-bc5d-c79bf85025c7 req-57705f60-14d9-49cc-946c-3478903e9929 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:54.040286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-cb51b8e5-1729-4c2f-bc5d-c79bf85025c7 req-57705f60-14d9-49cc-946c-3478903e9929 service nova] Creating event network-changed:361eed59-d4cf-441b-9aea-4b05fcc698aa for instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 on hv-cinder-83735 Jun 16 16:45:54.045283 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-cb51b8e5-1729-4c2f-bc5d-c79bf85025c7 req-57705f60-14d9-49cc-946c-3478903e9929 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029729 Jun 16 16:45:54.046110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 288/574] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:45:54.256387 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:54.256943 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:54.264083 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:54.264524 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:54.265280 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:54.265694 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:54.470830 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:54.479536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:54.481346 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:54.482756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-11ae36e2-f0d7-49f4-b131-838e42ea32c2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.230252 Jun 16 16:45:54.483555 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 287/575] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:54 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:55.515591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:55.516585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:55.526344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:55.526976 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:55.527959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:55.528456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:55.674664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:55.683435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:55.684864 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:55.686016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-98cfd6d9-87ba-427d-9edf-8434f1b242eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.186968 Jun 16 16:45:55.686586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 289/576] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:55 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:45:56.709650 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:56.710657 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:56.719527 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:56.719965 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:56.720718 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:56.721142 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:56.863521 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:56.873168 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:56.874665 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:56.875852 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8eb9a0ca-c97f-48b6-948e-8d6064dda7e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.172847 Jun 16 16:45:56.876382 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 288/577] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:56 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:57.899170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:57.900038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:57.911356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:57.912104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:57.913411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:57.914128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:58.047446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:58.056041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:58.057547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:58.058703 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8eee650b-0bd7-462b-afab-6689b5686232 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.166325 Jun 16 16:45:58.059339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 290/578] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:57 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:45:59.077216 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:45:59.077815 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:45:59.084919 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:59.085359 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:59.086119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:45:59.086509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:45:59.221968 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:59.224352 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:45:59.231861 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:59.234065 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:45:59.235269 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f0f3865a-66af-44f6-975b-d19563aa626e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.162348 Jun 16 16:45:59.235827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 289/579] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:45:59 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:00.255751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:00.256421 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:00.263290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:00.264094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:00.265443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:00.265873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:00.408544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:00.416735 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:00.418203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:00.419480 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9085a7bb-546f-458e-b1a1-eba2ac7f1840 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.168770 Jun 16 16:46:00.420508 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 291/580] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:00 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:01.444127 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:01.445039 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:01.454101 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:01.454546 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:01.455338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:01.455765 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:01.598456 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:01.606963 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:01.608714 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:01.609878 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-885b49ae-676a-4d20-ab2a-ccfb00763688 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1744 microversion: 2.20 time: 0.174153 Jun 16 16:46:01.619162 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 290/581] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:01 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1744 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:02.628624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:02.629216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:02.635829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:02.636271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:02.637078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:02.637449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:02.788088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:02.814850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:02.820604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:02.822119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bce78a08-2524-4b94-814c-91ba0dad2a08 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.197530 Jun 16 16:46:02.835932 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 292/582] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:02 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:03.846213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:03.846804 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:03.853610 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:03.854050 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:03.854827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:03.855443 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:03.993395 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:04.002603 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:04.004753 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:04.005903 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4d5d0c28-568f-4dca-b276-72557a9f324c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.164179 Jun 16 16:46:04.006489 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 291/583] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:03 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:05.025805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:05.026458 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:05.033943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:05.034379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:05.035195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:05.035602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:05.180166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:05.189307 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:05.190827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:05.192073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-63ddf814-3bf5-4c56-90c1-f99b56792a36 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.170470 Jun 16 16:46:05.192619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 293/584] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:05 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:06.210192 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:06.210848 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:06.218185 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:06.218659 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:06.219461 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:06.219988 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:06.359382 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:06.368410 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:06.369916 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:06.371074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-043517a6-6aa6-4f14-a073-35c66f0a5874 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.164877 Jun 16 16:46:06.371834 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 292/585] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:06 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:07.390049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:07.390771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:07.398369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:07.398812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:07.399585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:07.400199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:07.535383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:07.544459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:07.546193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:07.547445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-31eb7c37-d0d0-4f19-b039-5a2f91367938 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.161606 Jun 16 16:46:07.558611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 294/586] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:07 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:08.565730 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:08.566472 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:08.573509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:08.573973 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:08.575325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:08.575753 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:08.712950 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:08.722603 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:08.724124 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:08.725286 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2aa9068d-b5b8-4a7a-a6bb-e965a6f505b9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.163661 Jun 16 16:46:08.725854 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 293/587] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:08 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:09.743949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:09.744582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:09.751513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:09.752103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:09.752904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:09.753322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:09.886885 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:09.896430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:09.898250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:09.900152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d0e305ba-0e25-4764-a393-091bb6828599 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.160158 Jun 16 16:46:09.900889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 295/588] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:09 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:10.918209 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:10.918798 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:10.925621 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:10.926362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:10.927304 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:10.927726 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:11.071496 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:11.086790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:11.088423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:11.089590 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-be219a9c-ee37-465e-bf9e-419869afa82c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.175657 Jun 16 16:46:11.090315 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 294/589] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:10 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:12.108878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:12.109520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:12.116870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:12.117318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:12.118095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:12.118518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:12.262046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:12.272459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:12.274385 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:12.277726 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a7ddc34b-bc99-422f-83da-2f22f83c63f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.172286 Jun 16 16:46:12.287231 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-847054153", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "networks": [{"uuid": "8dbef14f-ece8-4358-aa70-26ffc281d9d8"}]}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:12.290375 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 296/590] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:12 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:12.340234 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.network.neutron [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] validate_networks() for [('8dbef14f-ece8-4358-aa70-26ffc281d9d8', None, None, None, None, None)] {{(pid=124103) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:46:12.766875 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Flavor limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:46:12.767342 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Image limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:46:12.767806 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Flavor pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:46:12.768198 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Image pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:46:12.768817 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:46:12.778258 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:12.778929 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:12.780086 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:12.780516 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:12.798623 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Getting quotas for project eb9beb4baa2b41808ba9ffa5f233ae48. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:46:12.803075 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Getting quotas for user 797350f034d24e7580beeb67e6693a53 and project eb9beb4baa2b41808ba9ffa5f233ae48. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:46:12.821149 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Going to run 1 instances... {{(pid=124103) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:46:12.823624 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:46:12.870303 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cc3901f0-64a1-4e49-85f6-72fc6c9a75cb tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587742 Jun 16 16:46:12.870955 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 295/591] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:46:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:46:12.884952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f07f21a9-9975-4a18-bfb0-b7e0f9550bd7 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:12.885729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f07f21a9-9975-4a18-bfb0-b7e0f9550bd7 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:12.971129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f07f21a9-9975-4a18-bfb0-b7e0f9550bd7 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:12.978722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f07f21a9-9975-4a18-bfb0-b7e0f9550bd7 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1218 microversion: 2.1 time: 0.100250 Jun 16 16:46:12.979306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 297/592] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:12 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:13.296164 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:13.296756 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:13.304238 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:13.304666 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:13.305471 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:13.306075 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:13.463602 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:13.472444 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:13.474490 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:13.476204 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e2e03789-e690-4555-ba32-abc1c5b1ae10 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.184002 Jun 16 16:46:13.476763 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 296/593] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:13 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:13.996674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:13.997959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:14.006560 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:14.007274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:14.008381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:14.008993 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:14.076532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:14.085307 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d1c720df-2f8b-45ec-9d65-dd29f9075afe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1270 microversion: 2.1 time: 0.092707 Jun 16 16:46:14.085929 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 298/594] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:13 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:14.495411 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:14.495999 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:14.503959 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:14.504607 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:14.505480 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:14.506109 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:14.731339 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:14.743567 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:14.745720 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:14.747251 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6535f6d0-5308-46a9-a8f0-24ef7fed16ae tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.255837 Jun 16 16:46:14.747914 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 297/595] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:14 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:15.105200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:15.105863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:15.112689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:15.113264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:15.114070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:15.114490 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:15.273843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:15.283309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-20ac753d-26af-48a0-9eaa-80e7b4a0f842 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.182249 Jun 16 16:46:15.284034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 299/596] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:15 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:15.768270 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:15.768834 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:15.778735 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:15.779494 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:15.780450 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:15.781033 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:16.018008 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:16.041628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:16.056114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:16.057570 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c5096c8b-c832-467e-88f8-aab89f21b0ea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.293838 Jun 16 16:46:16.075124 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 298/597] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:15 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:16.115318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-b865ddc1-e3bf-4f19-b116-7f1b3e403da5 req-05635661-baa7-4ff3-94c9-45777f2dad2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f87cf89-85cd-463b-9477-7588d7796193", "tag": "fdf23c85-d361-4506-aff9-8bf4208dc2a3"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:16.119287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:16.127209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-b865ddc1-e3bf-4f19-b116-7f1b3e403da5 req-05635661-baa7-4ff3-94c9-45777f2dad2e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:16.127973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-b865ddc1-e3bf-4f19-b116-7f1b3e403da5 req-05635661-baa7-4ff3-94c9-45777f2dad2e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:16.142626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-b865ddc1-e3bf-4f19-b116-7f1b3e403da5 req-05635661-baa7-4ff3-94c9-45777f2dad2e service nova] Creating event network-changed:fdf23c85-d361-4506-aff9-8bf4208dc2a3 for instance 0f87cf89-85cd-463b-9477-7588d7796193 on hv-cinder-83735 Jun 16 16:46:16.147707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-b865ddc1-e3bf-4f19-b116-7f1b3e403da5 req-05635661-baa7-4ff3-94c9-45777f2dad2e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135006 Jun 16 16:46:16.148470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 300/598] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:46:16.302515 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:16.303035 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:16.309504 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:16.309947 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:16.310772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:16.311212 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:16.803196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:16.814482 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-320a6488-10b7-4d36-aef7-9672db3c4ff9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.516749 Jun 16 16:46:16.815875 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 299/599] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:16 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:17.077501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:17.078117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:17.085466 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:17.085908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:17.086665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:17.087164 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:17.091676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:17.225117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:17.234764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:17.236468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:17.238040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b495704e-8a60-4dd9-9b99-83ff9f88e7a0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.164786 Jun 16 16:46:17.249712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 301/600] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:17 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:17.832908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:17.833687 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:17.836097 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:17.842353 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:17.842836 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:17.843823 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:17.844263 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:17.978284 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:17.986493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-116cbbc1-00fc-436b-b5e1-d128c69f7af6 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.158130 Jun 16 16:46:17.987069 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 300/601] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:17 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:18.257630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:18.258269 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:18.265451 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:18.265901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:18.266639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:18.267095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:18.407491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:18.416180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:18.417718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:18.418922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-00c97e3a-c39b-4bcd-9b4c-8af06342902c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.165835 Jun 16 16:46:18.419538 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 302/602] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:18 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:18.853145 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1603057276", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-863924614", "security_groups": [{"name": "tempest-secgroup-smoke-2010524793"}], "block_device_mapping_v2": [{"uuid": "e61b905c-28b4-405f-9317-50db2a7db104", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58debe88-786d-44f3-b73a-fe19aa3ec834"}]}} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:18.976764 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.network.neutron [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] validate_networks() for [('58debe88-786d-44f3-b73a-fe19aa3ec834', None, None, None, None, None)] {{(pid=124103) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:46:19.006496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:19.007127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:19.013206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:19.013647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:19.014752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:19.015202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:19.370500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:19.378216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a6a86836-4232-4895-aaef-b583d5f5acbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.376648 Jun 16 16:46:19.378788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 303/603] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:19 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:19.381581 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Flavor limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:46:19.381989 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Image limits 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:46:19.382449 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Flavor pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:46:19.382844 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Image pref 0:0:0 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:46:19.383278 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.virt.hardware [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124103) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:46:19.392788 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:19.393224 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:19.394002 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:19.394821 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:19.411163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:46:19.414980 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.quota [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for user d162fcafed2c4ae099a5786cceb84891 and project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'cores', 'instances', 'ram'} {{(pid=124103) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:46:19.438032 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:19.438623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:19.445290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:19.445731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:19.446491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:19.446922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:19.472051 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Going to run 1 instances... {{(pid=124103) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:46:19.474100 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e61b905c-28b4-405f-9317-50db2a7db104',volume_size=None,volume_type=None)] {{(pid=124103) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:46:19.585666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:19.593797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:19.595323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:19.596482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-376ceea3-2667-4501-8977-323e0fa789b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.162707 Jun 16 16:46:19.597038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 304/604] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:19 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:19.617114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e7fe16b2-466c-4deb-92d3-13f5cf7327c8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.770319 Jun 16 16:46:19.617731 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 301/605] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:46:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:46:19.627789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-13317a94-7d51-4643-8c36-6f505c071105 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:19.628885 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-13317a94-7d51-4643-8c36-6f505c071105 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:19.686528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-13317a94-7d51-4643-8c36-6f505c071105 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:19.693486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-13317a94-7d51-4643-8c36-6f505c071105 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1094 microversion: 2.1 time: 0.069605 Jun 16 16:46:19.694356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 305/606] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:19 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:20.401402 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:20.402262 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:20.412883 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:20.413326 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:20.414057 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:20.414514 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:20.561718 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:20.569885 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8404c5d3-03f9-4f08-8f10-ebc6c6395dbe tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.176188 Jun 16 16:46:20.570460 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 302/607] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:20 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:20.616434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:20.617025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:20.624829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:20.625276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:20.626035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:20.626448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:20.711194 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:20.711194 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:20.717810 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:20.718268 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:20.719101 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:20.719713 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:20.764270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:20.772913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:20.774406 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:20.775746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-46c5178f-5dd5-4c43-a682-95cb4e2ab0eb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.163327 Jun 16 16:46:20.776313 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 306/608] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:20 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:20.785447 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:20.793496 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d29211e3-c4f3-49df-8798-7c25465b4f2c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1144 microversion: 2.1 time: 0.087337 Jun 16 16:46:20.794073 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 303/609] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:20 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:21.586871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:21.587521 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:21.593933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:21.594452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:21.595316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:21.595813 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:21.739962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:21.747988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6bb8adb6-d3e3-4bae-985c-afa6eca2e173 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.165399 Jun 16 16:46:21.748571 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 307/610] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:21 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:21.795769 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:21.796536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:21.805686 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:21.806464 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:21.807478 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:21.808111 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:21.811419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:21.814963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:21.822050 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:21.822881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:21.823859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:21.824623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:21.909254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:21.918512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-23724f0e-0ee9-46d1-bd81-29915cd913ca tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1192 microversion: 2.1 time: 0.111229 Jun 16 16:46:21.922332 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 308/611] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:21 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1192 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:46:21.981513 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:21.990416 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:21.992078 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:21.993314 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-287bf883-d3f9-475e-bf49-9557ec8169a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1739 microversion: 2.20 time: 0.202127 Jun 16 16:46:21.993950 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 304/612] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:21 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:22.768980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:22.769892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:22.780121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:22.780834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:22.781965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:22.782630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:22.917168 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:22.924948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3046057d-75f4-49db-b22b-8e5e7bc38a9f tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.162265 Jun 16 16:46:22.926164 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 309/613] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:22 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:22.937678 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:22.943143 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:22.952457 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:22.953515 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:22.954399 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:22.954959 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:23.014235 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:23.015183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:23.021799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:23.022241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:23.023200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:23.023783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:23.060988 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:23.070421 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-905f0562-2181-483d-8c24-7ef7fd31d547 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1192 microversion: 2.1 time: 0.138208 Jun 16 16:46:23.071043 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 305/614] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:22 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1192 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:23.174358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:23.182856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:23.184361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:23.185525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-11cedada-40d7-4848-86d0-c6b69e33e13e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1721 microversion: 2.20 time: 0.175512 Jun 16 16:46:23.186084 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 310/615] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:23 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:23.942597 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:23.943216 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:23.949693 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:23.950131 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:23.950925 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:23.951344 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:24.087852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:24.088473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:24.095251 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:24.095680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:24.096439 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:24.096871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:24.130881 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:24.138647 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-63e9abbc-691f-4c38-b509-f9cd3e1aa2d9 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.200271 Jun 16 16:46:24.149301 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 306/616] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:23 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:24.162026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:24.169638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c214920a-f077-4650-a1d2-0448767cfe9f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1210 microversion: 2.1 time: 0.085841 Jun 16 16:46:24.170389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 311/617] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:24 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:46:24.204579 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:24.205484 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:24.212663 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:24.213452 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:24.214426 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:24.215035 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:24.374835 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:24.377277 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:24.385139 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:24.386763 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:24.388189 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d2826364-dbdf-4230-8797-394468f9c06e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1721 microversion: 2.20 time: 0.187981 Jun 16 16:46:24.388785 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 307/618] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:24 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:24.969834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-02cbb249-9775-4018-83ef-cf3dc5e2e731 req-532f10a4-fd90-42aa-905c-65e980ed8f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f87cf89-85cd-463b-9477-7588d7796193", "name": "network-vif-plugged", "status": "completed", "tag": "fdf23c85-d361-4506-aff9-8bf4208dc2a3"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:24.979574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-02cbb249-9775-4018-83ef-cf3dc5e2e731 req-532f10a4-fd90-42aa-905c-65e980ed8f74 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:24.980020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-02cbb249-9775-4018-83ef-cf3dc5e2e731 req-532f10a4-fd90-42aa-905c-65e980ed8f74 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:24.992031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-02cbb249-9775-4018-83ef-cf3dc5e2e731 req-532f10a4-fd90-42aa-905c-65e980ed8f74 service nova] Creating event network-vif-plugged:fdf23c85-d361-4506-aff9-8bf4208dc2a3 for instance 0f87cf89-85cd-463b-9477-7588d7796193 on hv-cinder-83735 Jun 16 16:46:24.996896 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-02cbb249-9775-4018-83ef-cf3dc5e2e731 req-532f10a4-fd90-42aa-905c-65e980ed8f74 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Jun 16 16:46:24.997479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 312/619] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:46:25.158610 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:25.159325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:25.166637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:25.167099 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:25.167874 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:25.168301 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:25.188746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:25.189447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:25.196230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:25.196715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:25.197504 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:25.197933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:25.302853 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:25.310936 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-5589b57d-18cc-4d76-96ed-1fb1607faf69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.156306 Jun 16 16:46:25.311513 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 308/620] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:25 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:25.330648 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:25.338601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4c7aceee-f6c6-4aef-b58f-f6b061a7a8aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1278 microversion: 2.1 time: 0.154553 Jun 16 16:46:25.339167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 313/621] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:25 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1278 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:25.408066 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:25.408769 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:25.415319 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:25.415767 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:25.416526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:25.416959 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:25.574026 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:25.582904 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:25.584540 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:25.585993 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cb6827c2-a7f0-4733-ac33-3c3ca18f2d15 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1721 microversion: 2.20 time: 0.181946 Jun 16 16:46:25.586563 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 309/622] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:25 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:26.261439 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-984c2ed3-8660-4844-9203-d93631f8c508 req-d0bf9d9f-269d-49ce-b6ef-074879ba5932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e74018d-237a-4638-972d-b5b85e487dc5", "tag": "6c3cf76d-086d-4831-b63d-173afc22d303"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:26.270448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-984c2ed3-8660-4844-9203-d93631f8c508 req-d0bf9d9f-269d-49ce-b6ef-074879ba5932 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.270880 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-984c2ed3-8660-4844-9203-d93631f8c508 req-d0bf9d9f-269d-49ce-b6ef-074879ba5932 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.288919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-984c2ed3-8660-4844-9203-d93631f8c508 req-d0bf9d9f-269d-49ce-b6ef-074879ba5932 service nova] Creating event network-changed:6c3cf76d-086d-4831-b63d-173afc22d303 for instance 8e74018d-237a-4638-972d-b5b85e487dc5 on hv-cinder-83735 Jun 16 16:46:26.293975 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-984c2ed3-8660-4844-9203-d93631f8c508 req-d0bf9d9f-269d-49ce-b6ef-074879ba5932 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036921 Jun 16 16:46:26.294667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 314/623] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:46:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:46:26.331041 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:26.331693 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:26.338850 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.339311 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.340073 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.340492 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.356003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:26.356829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:26.363733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.364297 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.365059 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.365482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.484740 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:26.492566 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-4d52915a-7aa1-4cf2-85d8-ee56aad313a3 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.167540 Jun 16 16:46:26.493141 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 310/624] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:26 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:26.508078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:26.515734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d80a128a-6f3d-484d-bbad-6139c57d2db8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.163923 Jun 16 16:46:26.516301 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 315/625] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:26 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:46:26.610039 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:26.610636 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:26.617852 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.618296 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.619080 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.619519 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.753654 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:26.766400 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:26.768808 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:26.770830 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-15b480e6-e745-494c-965c-b4efea667697 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1724 microversion: 2.20 time: 0.164794 Jun 16 16:46:26.771454 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 311/626] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:26 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:26.791778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-41f54de6-7244-4049-9af9-4bf94ea18297 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8c52455-b61e-4153-95bc-1506e09595bb"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:26.793350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-41f54de6-7244-4049-9af9-4bf94ea18297 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:26.802156 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41f54de6-7244-4049-9af9-4bf94ea18297 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.802594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41f54de6-7244-4049-9af9-4bf94ea18297 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:26.803377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41f54de6-7244-4049-9af9-4bf94ea18297 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:26.803811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41f54de6-7244-4049-9af9-4bf94ea18297 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.104908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-0d99552f-9f0d-4385-9cba-5e019dae28ec req-b8e34ae2-f4f9-4e5d-ae74-467e0ba916fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f89d4-2837-48f0-854e-4267acb270bb", "name": "network-vif-unplugged", "status": "completed", "tag": "6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:27.113101 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-0d99552f-9f0d-4385-9cba-5e019dae28ec req-b8e34ae2-f4f9-4e5d-ae74-467e0ba916fd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.113518 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-0d99552f-9f0d-4385-9cba-5e019dae28ec req-b8e34ae2-f4f9-4e5d-ae74-467e0ba916fd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.127163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-0d99552f-9f0d-4385-9cba-5e019dae28ec req-b8e34ae2-f4f9-4e5d-ae74-467e0ba916fd service nova] Creating event network-vif-unplugged:6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d for instance 0b7f89d4-2837-48f0-854e-4267acb270bb on hv-cinder-83735 Jun 16 16:46:27.132768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-0d99552f-9f0d-4385-9cba-5e019dae28ec req-b8e34ae2-f4f9-4e5d-ae74-467e0ba916fd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102117 Jun 16 16:46:27.133352 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 312/627] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:46:27.152623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-41f54de6-7244-4049-9af9-4bf94ea18297 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.367365 Jun 16 16:46:27.153329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 316/628] 10.222.0.74 () {62 vars in 1363 bytes} [Thu Jun 16 16:46:26 2022] POST /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:46:27.271731 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-44779706-be4d-4ea7-a8fa-9c1a235eaeaa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:27.272361 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-44779706-be4d-4ea7-a8fa-9c1a235eaeaa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:27.279037 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-44779706-be4d-4ea7-a8fa-9c1a235eaeaa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.279620 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-44779706-be4d-4ea7-a8fa-9c1a235eaeaa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.280451 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-44779706-be4d-4ea7-a8fa-9c1a235eaeaa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.280946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-44779706-be4d-4ea7-a8fa-9c1a235eaeaa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.384509 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-44779706-be4d-4ea7-a8fa-9c1a235eaeaa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/action" status: 202 len: 0 microversion: 2.20 time: 0.117124 Jun 16 16:46:27.385283 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 313/629] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Jun 16 16:46:27 2022] POST /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:46:27.393966 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:27.394633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:27.401990 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.402440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.403317 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.403747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.419387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:27.509380 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:27.510190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:27.518348 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.518876 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.520194 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.520873 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.547680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:27.557813 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:27.559342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:27.560508 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-86a2ecb7-4a73-438c-8136-f4ff7346a888 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1810 microversion: 2.20 time: 0.170953 Jun 16 16:46:27.561060 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 317/630] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:27 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:27.565679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:27.566597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:27.572843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.573284 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.574041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:27.574467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:27.676465 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:27.686012 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3ca1ec3b-1984-4cc6-805e-e8d14ecf3b69 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1318 microversion: 2.1 time: 0.180480 Jun 16 16:46:27.687088 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 314/631] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:27 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:46:27.721174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:27.729477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7f2ba45a-8e46-4026-a8e8-d1d1fde3a56e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.167243 Jun 16 16:46:27.730032 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 318/632] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:27 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:28.579949 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:28.580571 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:28.587608 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.588045 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.588791 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.589212 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.702909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:28.703544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:28.711394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.711842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.712602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.713029 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.729362 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:28.737809 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:28.739837 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:28.741318 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-71dd3af7-7a63-46ec-ad0f-6ed06a227e7e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1750 microversion: 2.20 time: 0.165377 Jun 16 16:46:28.752119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 315/633] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:28 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1750 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:28.752119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:28.752119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:28.753377 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.753890 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.754617 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.755114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.849893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:28.857682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f0d56250-3ffc-45aa-84bb-2d4b573be746 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1508 microversion: 2.1 time: 0.159091 Jun 16 16:46:28.858220 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 319/634] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:28 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:28.874330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4ef2cbc5-cdaf-463f-b506-2febdf5c66ec tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c40628d4-6b83-489c-850e-68b959fed9a4", "device": "/dev/sdb"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:46:28.875562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4ef2cbc5-cdaf-463f-b506-2febdf5c66ec tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:28.882206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ef2cbc5-cdaf-463f-b506-2febdf5c66ec tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.882650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ef2cbc5-cdaf-463f-b506-2febdf5c66ec tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.883449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ef2cbc5-cdaf-463f-b506-2febdf5c66ec tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:28.884639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ef2cbc5-cdaf-463f-b506-2febdf5c66ec tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:28.890305 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:28.899004 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b6aad1b8-d8f4-41ec-96a9-cb40aa4007ee tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.156254 Jun 16 16:46:28.899614 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 316/635] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:28 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:29.280166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4ef2cbc5-cdaf-463f-b506-2febdf5c66ec tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "POST /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408962 Jun 16 16:46:29.281897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 320/636] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:46:28 2022] POST /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193/os-volume_attachments => generated 194 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:46:29.762968 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:29.763618 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:29.766802 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=4 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:29.767536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell0:SELECT=12 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:29.775262 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:29.775700 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:29.776450 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:29.776871 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:29.914810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:29.916017 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:29.921192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:29.922276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:29.928705 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:29.930189 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:29.930833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:29.931367 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-da07b588-000b-4009-a612-d67f2e4e26ac tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1752 microversion: 2.20 time: 0.174972 Jun 16 16:46:29.931567 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:29.932309 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 317/637] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:29 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1752 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:29.932432 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:29.932779 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:30.072138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:30.083941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-80191dcc-4aa8-49a9-b503-f707e16fe122 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.171573 Jun 16 16:46:30.084583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 321/638] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:29 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:30.951184 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:30.952549 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:30.960458 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:30.960929 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:30.961732 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:30.962184 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:31.099281 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:31.101208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:31.101819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:31.108540 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:31.108818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:31.109266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:31.110033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:31.110129 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:31.110462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:31.111214 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-16719fc8-00db-4add-968b-0912505eb641 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1752 microversion: 2.20 time: 0.164211 Jun 16 16:46:31.111768 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 318/639] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:30 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:31.249040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:31.257387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c622b19e-1564-4ed1-848f-00df94bd4272 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.160090 Jun 16 16:46:31.257999 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 322/640] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:31 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:32.130282 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:32.131733 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:32.141296 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:32.141772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:32.142776 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:32.143335 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:32.274583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:32.275186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:32.282585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:32.283044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:32.283984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:32.284412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:32.432038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:32.439939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8d4fd48e-a8bf-4294-80c5-5ca7d42a2915 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.169398 Jun 16 16:46:32.441460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 323/641] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:32 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:32.592445 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:32.602391 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:32.603916 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:32.605065 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-893421c6-0c03-4735-afdd-415af6ab9dc1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.479039 Jun 16 16:46:32.605620 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 319/642] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:32 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:33.457320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:33.458115 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:33.464892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:33.465577 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:33.466486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:33.467073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:33.612694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:33.621129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a63c1dcd-894f-400e-8ffa-420c1d33e33d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.167666 Jun 16 16:46:33.621698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 324/643] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:33 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:33.622871 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:33.623516 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:33.630081 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:33.630523 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:33.631299 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:33.631725 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:33.767074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:33.775754 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:33.777261 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:33.778449 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-27324a9c-363f-4a30-8afc-1892690aaa39 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.159422 Jun 16 16:46:33.779004 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 320/644] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:33 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:46:34.638568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:34.639303 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:34.646492 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:34.646986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:34.647785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:34.648218 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:34.787077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:34.794810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-81b72087-a804-4d41-8f1c-ae9adaf739e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.160154 Jun 16 16:46:34.795478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 325/645] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:34 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:34.797528 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:34.798179 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:34.805320 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:34.805977 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:34.806724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:34.807325 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:34.940517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:34.949145 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:34.950628 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:34.951772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-3a65ab5c-9f71-48cd-9017-93ed80d6d360 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.158885 Jun 16 16:46:34.952326 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 321/646] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:34 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:35.814386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:35.814995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:35.822760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:35.823231 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:35.824005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:35.824472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:35.959207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:35.970452 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:35.971037 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:35.977208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-66a268fc-1672-4318-a3e2-03e425ac977d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.168569 Jun 16 16:46:35.977798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 326/647] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:35 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:35.978322 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:35.978815 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:35.979821 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:35.980083 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:36.126352 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:36.135276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:36.136863 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:36.137993 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-189500d9-7f55-4b78-a230-ed2dc55af46e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.171722 Jun 16 16:46:36.138533 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 322/648] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:35 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:36.995289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:36.995920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:37.004000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:37.004945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:37.005841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:37.006244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:37.148296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:37.156235 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e3d8a2ab-1f46-44a5-80ed-9b3ccf30853d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.165601 Jun 16 16:46:37.162163 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:37.162820 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:37.164372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 327/649] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:36 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:37.169599 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:37.170040 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:37.170798 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:37.171265 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:37.310793 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:37.320074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:37.321586 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:37.322745 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-bc24c865-9a57-4463-a28a-ebb4ec566e13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.164917 Jun 16 16:46:37.323437 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 323/650] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:37 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:46:38.181395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:38.182035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:38.190194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:38.190619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:38.191675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:38.192102 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:38.331198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:38.341830 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:38.342420 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:38.348419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-acdf282f-c40f-4419-b0d6-9eedb589cd42 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.171305 Jun 16 16:46:38.355379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 328/651] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:38 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:38.355574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:38.355574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:38.355574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:38.355574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:38.355935 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:38.490556 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:38.499338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:38.500864 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:38.502017 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-bf91a34d-2996-456e-b921-3f9139627525 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.164117 Jun 16 16:46:38.502574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 324/652] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:38 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:39.364729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:39.365311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:39.372427 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:39.372872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:39.373679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:39.374108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:39.514196 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:39.521821 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:39.522529 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:39.522901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-94c4f586-066c-4021-892f-7ebbbbb46963 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.162179 Jun 16 16:46:39.523543 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 329/653] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:39 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:39.532279 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:39.532822 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:39.533643 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:39.534081 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:39.677245 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:39.685784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:39.687343 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:39.688500 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-464623dd-04e4-4e1b-933b-e1a0313d3964 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.170670 Jun 16 16:46:39.689067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 325/654] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:39 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:46:40.542561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:40.544403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:40.554039 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:40.554491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:40.555272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:40.555690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:40.695664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:40.703099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-99b11cbd-c628-4e56-b60d-2aa62990ca31 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.165921 Jun 16 16:46:40.703670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 330/655] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:40 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:40.706696 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:40.707351 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:40.714289 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:40.714729 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:40.715507 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:40.715935 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:40.854692 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:40.863320 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:40.865024 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:40.866653 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9acfd687-60a2-49b3-9893-19df5ea46c74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.163424 Jun 16 16:46:40.867192 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 326/656] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:40 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:41.720645 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:41.721294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:41.728442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:41.728950 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:41.729647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:41.730067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:41.868977 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:41.878280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e824bbb7-a43a-4cce-a542-5123a82234c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.161458 Jun 16 16:46:41.878851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 331/657] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:41 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:41.886979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:41.886979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:41.892593 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:41.893022 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:41.893812 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:41.894242 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:42.027536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:42.036418 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:42.037982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:42.039175 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-30414848-4eff-4030-8f6a-af77a34b1ce6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.158227 Jun 16 16:46:42.039922 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 327/658] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:41 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:46:42.896051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:42.896752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:42.903294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:42.903736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:42.904489 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:42.904920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:43.048323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:43.051517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:43.058125 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:43.060113 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:43.060604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3669bc6e-f007-42ae-9184-c1b3007648b2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.168584 Jun 16 16:46:43.061342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 332/659] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:42 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:43.067044 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:43.067518 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:43.068352 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:43.068780 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:43.214328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:43.222965 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:43.224624 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:43.225840 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-f3feada1-1d49-49e2-9ae6-72b9d820f401 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.171592 Jun 16 16:46:43.226435 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 328/660] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:43 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:44.078037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:44.078655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:44.086609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:44.087066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:44.087831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:44.088255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:44.225628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:44.233127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b179e32a-cdf9-44b9-b39e-cddb14918a05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.159216 Jun 16 16:46:44.233685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 333/661] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:44 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:44.249446 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:44.250017 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:44.256924 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:44.257359 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:44.258098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:44.258519 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:44.395687 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:44.408417 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:44.409942 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:44.411130 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-aa4d6fb3-d108-4010-bf43-8343b7b2e7a5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.165537 Jun 16 16:46:44.411743 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 329/662] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:44 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:45.250223 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:45.251595 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:45.258515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:45.259092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:45.259875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:45.260333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:45.396768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:45.404811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-97150431-5317-446c-b46f-27b70de507e1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.158695 Jun 16 16:46:45.405419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 334/663] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:45 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:45.429855 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:45.430468 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:45.437472 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:45.437919 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:45.438685 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:45.439125 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:45.578020 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:45.588216 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:45.589714 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:45.590889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-693036c6-4e04-4b43-b2f8-0990d58c434b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.165618 Jun 16 16:46:45.591494 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 330/664] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:45 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:46.421974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:46.422612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:46.428641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=72 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:46.430959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:46.431642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:46.432599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:46.433031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:46.574503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:46.582758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fc0258fd-0c7b-423e-8525-28290528f14a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.164680 Jun 16 16:46:46.583603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 335/665] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:46 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:46.609607 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:46.610237 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:46.617190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:46.617632 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:46.618396 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:46.618827 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:46.758377 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:46.768065 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:46.769574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:46.770770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-d63771ee-3f72-40ef-841c-072c71627388 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.165188 Jun 16 16:46:46.771406 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 331/666] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:46 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:47.601047 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:47.601645 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:47.608615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:47.609054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:47.609799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:47.610228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:47.773585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:47.781432 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b12bd668-3487-4a67-a2f4-d646c65b178b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.184474 Jun 16 16:46:47.792961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 336/667] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:47 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:47.793178 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:47.793178 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:47.796323 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:47.796770 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:47.797541 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:47.797962 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:47.940688 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:47.949637 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:47.951156 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:47.952314 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cfa1256f-c0a4-4fcd-857f-5e0ffd7533db tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.167833 Jun 16 16:46:47.952875 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 332/668] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:47 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:46:48.800152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:48.801069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:48.808583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:48.809029 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:48.809797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:48.810227 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:48.954370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:48.962809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-58d31d32-f7af-4867-91f8-73de875624a7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.166467 Jun 16 16:46:48.963453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 337/669] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:48 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:48.973170 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:48.973846 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:48.980953 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:48.983384 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:48.983790 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:48.984856 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:48.985683 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:49.123233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:49.132143 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:49.133622 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:49.134772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-36589f46-442f-4930-ba05-be0ab1321002 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.166955 Jun 16 16:46:49.135476 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 333/670] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:48 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:49.980787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:49.981432 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:49.988667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:49.989103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:49.989860 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:49.990688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:50.135133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:50.143409 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7f98861c-f56b-4121-880a-9fe4c9a34d15 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.166582 Jun 16 16:46:50.143986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 338/671] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:49 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:50.154588 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:50.155194 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:50.164100 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:50.164560 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:50.165305 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:50.165724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:50.304375 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:50.314652 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:50.316616 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:50.317976 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-a39c79ed-40e7-4583-9077-00fb9a3cdb3c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.168143 Jun 16 16:46:50.319358 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 334/672] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:50 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:51.162070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:51.162708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:51.169851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:51.170298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:51.171070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:51.171505 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:51.321913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:51.333103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-80af9452-1ab4-4966-a694-be06aa108f87 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.175999 Jun 16 16:46:51.334027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 339/673] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:51 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:51.340964 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:51.341712 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:51.348685 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:51.349119 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:51.350147 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:51.350663 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:51.488310 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:51.498257 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:51.499802 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:51.500958 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-70cb27a1-b027-4c2b-88d4-b80cd2c05764 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.166675 Jun 16 16:46:51.501629 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 335/674] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:51 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:52.354403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:52.355236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:52.365871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:52.366266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:52.367026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:52.367492 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:52.506136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:52.514324 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2066467d-4ef4-4780-840e-8e3b5d56cf8f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.166921 Jun 16 16:46:52.514893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 340/675] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:52 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:52.519780 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:52.520397 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:52.529463 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:52.530063 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:52.530825 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:52.531283 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:52.665459 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:52.673096 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:52.674574 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:52.675758 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6a68f44f-2cb1-471f-9e03-1ce5cd2bf118 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.160311 Jun 16 16:46:52.676352 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 336/676] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:52 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:53.533667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:53.534470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:53.543849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:53.544441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:53.545459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:53.546036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:53.685066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:53.692766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-88ac6f10-0687-4758-baf8-7043163ac685 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.164354 Jun 16 16:46:53.693337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 341/677] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:53 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:53.694195 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:53.694809 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:53.701483 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:53.701925 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:53.702682 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:53.703134 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:53.853475 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:53.862257 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:53.863782 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:53.864925 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-093ad2cb-579f-4dc7-aaa8-897bfca8c2e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.175180 Jun 16 16:46:53.865717 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 337/678] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:53 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:46:54.710875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:54.711527 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:54.719018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:54.719954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:54.720855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:54.721308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:54.863641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:54.871887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e03c4bf8-4da8-4864-8c0e-04b14e470895 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.165480 Jun 16 16:46:54.872467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 342/679] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:54 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:54.893546 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:54.894162 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:54.904165 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:54.904815 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:54.905977 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:54.906656 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:55.046098 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:55.054947 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:55.056473 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:55.057680 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-de94a132-8619-4907-bc2f-90e2293ac177 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.170813 Jun 16 16:46:55.058224 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 338/680] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:54 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:55.889453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:55.890249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:55.899700 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:55.900138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:55.901011 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:55.901443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:56.057583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:56.065947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-16e66abe-d152-49bd-b265-ee275901cc94 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.180283 Jun 16 16:46:56.066533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 343/681] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:55 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:56.076957 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:56.077550 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:56.085551 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:56.086000 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:56.086774 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:56.087243 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:56.239575 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:56.252895 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:56.254843 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:56.256341 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-a353ffbc-639d-4ae0-bb74-ebf589ffccea tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.183450 Jun 16 16:46:56.256907 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 339/682] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:56 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:57.084444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:57.085010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:57.092050 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:57.092500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:57.093264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:57.094837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:57.234629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:57.247123 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7b816749-794d-4dac-9d82-2deddfcf7df1 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.166488 Jun 16 16:46:57.248062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 344/683] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:57 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:57.283658 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:57.284565 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:57.295001 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:57.295678 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:57.296891 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:57.297565 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:57.443075 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:57.445603 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:46:57.453180 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:57.454673 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:57.455853 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-05c97918-8d03-43a8-a6ba-8a0c60fb366c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.178279 Jun 16 16:46:57.456422 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 340/684] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:57 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:58.268771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:58.269416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:58.276938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:58.277379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:58.278145 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:58.278566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:58.410265 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:58.418263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d2a1887c-ff1d-44e0-a630-3a87969c2fde tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.154454 Jun 16 16:46:58.418833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 345/685] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:58 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:58.474331 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:58.475141 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:58.482133 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:58.482569 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:58.483354 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:58.483772 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:58.620488 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:58.629143 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:58.630652 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:58.632276 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b96ee3ed-ee53-440b-9286-3cdfaaf5ae26 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.162131 Jun 16 16:46:58.632841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 341/686] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:58 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:46:59.438883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:59.439957 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:59.448251 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:59.448694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:59.449456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:59.449875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:59.593360 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:59.601720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-63f09b23-94e0-4923-a554-2df5d21c0786 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.169456 Jun 16 16:46:59.602265 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 346/687] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:46:59 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:46:59.651350 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:46:59.651928 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:46:59.658922 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:59.659392 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:59.660142 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:46:59.660595 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:46:59.803101 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:59.811709 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:59.813205 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:46:59.814363 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-bd82435a-dde5-4e92-81ac-9b4273eff048 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.167052 Jun 16 16:46:59.814926 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 342/688] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:46:59 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:00.622197 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:00.622846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:00.629717 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:00.630163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:00.631090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:00.631674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:00.787304 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:00.797947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0e87ebd7-d9b8-4ca8-99f0-6ca7792ca0af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.179446 Jun 16 16:47:00.798756 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 347/689] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:00 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:00.843499 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:00.844063 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:00.853125 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:00.853590 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:00.854322 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:00.854748 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:00.994647 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:01.006242 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:01.008582 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:01.010443 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-ffc63740-405f-4abe-b8f7-173467f62824 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.173171 Jun 16 16:47:01.011385 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 343/690] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:00 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:01.800511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-3e78a460-a458-40fd-b28e-9490d29b6386 req-0a5dff59-e63a-44b7-9f28-82781628713e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e74018d-237a-4638-972d-b5b85e487dc5", "name": "network-vif-plugged", "status": "completed", "tag": "6c3cf76d-086d-4831-b63d-173afc22d303"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:47:01.812239 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-3e78a460-a458-40fd-b28e-9490d29b6386 req-0a5dff59-e63a-44b7-9f28-82781628713e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:01.812685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-3e78a460-a458-40fd-b28e-9490d29b6386 req-0a5dff59-e63a-44b7-9f28-82781628713e service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:01.816091 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:01.816920 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:01.823233 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:01.823789 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:01.824641 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:01.825157 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:01.827258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-3e78a460-a458-40fd-b28e-9490d29b6386 req-0a5dff59-e63a-44b7-9f28-82781628713e service nova] Creating event network-vif-plugged:6c3cf76d-086d-4831-b63d-173afc22d303 for instance 8e74018d-237a-4638-972d-b5b85e487dc5 on hv-cinder-83735 Jun 16 16:47:01.833539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-3e78a460-a458-40fd-b28e-9490d29b6386 req-0a5dff59-e63a-44b7-9f28-82781628713e service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036913 Jun 16 16:47:01.834823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 348/691] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:47:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:47:01.971169 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:01.979420 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7c6f0666-e4c7-4f79-8608-fba7269897e8 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.167352 Jun 16 16:47:01.980014 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 344/692] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:01 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:47:02.034984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:02.035723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:02.042529 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:02.042974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:02.043778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:02.044193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:02.182084 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:02.193946 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:02.195627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:02.196785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-76ad3f51-8537-4ffa-b940-71332aab424e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.166970 Jun 16 16:47:02.197354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 349/693] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:02 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:03.000469 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:03.001523 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:03.010781 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:03.011270 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:03.012026 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:03.012459 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:03.151687 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:03.159301 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-6485846d-e26a-4eeb-975e-3cec23879441 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.165390 Jun 16 16:47:03.159911 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 345/694] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:02 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:03.215550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:03.216109 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:03.223107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:03.223577 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:03.224329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:03.224756 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:03.227552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:03.372342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:03.385953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:03.388370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:03.390121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fe9aec49-3a79-4a3e-967c-39c903ebc74f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.178227 Jun 16 16:47:03.390907 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 350/695] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:03 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:04.177338 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:04.177960 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:04.185209 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:04.185650 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:04.186470 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:04.186897 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:04.340374 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:04.348544 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b294481b-aa77-4df3-97a0-d55512abefed tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.175430 Jun 16 16:47:04.349308 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 346/696] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:04 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:04.412177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:04.412842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:04.420292 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:04.420774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:04.421579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:04.422037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:04.564710 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:04.573740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:04.575253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:04.576403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4eb9ce25-dda0-4adb-944b-10d7f60ea84a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.170437 Jun 16 16:47:04.576985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 351/697] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:04 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:05.366383 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:05.366997 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:05.374177 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:05.374623 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:05.375423 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:05.375854 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:05.509621 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:05.521217 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-eef8027d-fbde-45b4-b599-f6eafb763372 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.158950 Jun 16 16:47:05.522114 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 347/698] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:05 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:05.598213 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:05.598962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:05.609789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:05.610436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:05.611852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:05.612471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:05.748489 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:05.757796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:05.759299 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:05.760461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0f62ea08-e74e-473f-a06e-2c7b1e19ea2b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.168403 Jun 16 16:47:05.761028 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 352/699] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:05 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:06.540514 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:06.541141 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:06.548099 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:06.548539 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:06.549302 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:06.549728 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:06.684910 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:06.692911 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-8263a8cb-464d-41f4-bd03-ea6aa1f3702f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.157379 Jun 16 16:47:06.693491 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 348/700] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:06 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:06.779365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:06.779948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:06.787273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:06.787781 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:06.788630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:06.789053 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:06.921826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:06.930722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:06.932195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:06.933474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-30b1cbb3-5ef7-4cf5-a95f-bff331eda930 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.158063 Jun 16 16:47:06.933940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 353/701] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:06 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:07.714517 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:07.715556 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:07.726978 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:07.727454 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:07.728214 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:07.728644 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:07.871834 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:07.879697 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-7da3d7bf-f1d7-4426-80d7-11bee7514e28 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.171773 Jun 16 16:47:07.880251 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 349/702] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:07 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:07.955914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:07.956906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:07.964850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:07.965209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:07.965967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:07.966398 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:08.115888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:08.124857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:08.126332 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:08.127522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c3d92be6-9a33-47ac-b0ed-3eb7f0dcf3df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.178131 Jun 16 16:47:08.128086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 354/703] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:07 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:08.898425 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:08.898999 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:08.906782 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:08.907366 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:08.908213 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:08.908702 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:09.059493 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:09.067750 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-750318cc-27a9-4c92-b2d2-c0b7ac073a1c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.174013 Jun 16 16:47:09.068349 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 350/704] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:08 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:09.146639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:09.147755 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:09.154377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:09.154757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:09.155553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:09.155980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:09.301487 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:09.311024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:09.312572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:09.313727 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-32e73bd1-393a-4700-a0a6-3060347a2895 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.171201 Jun 16 16:47:09.314294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 355/705] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:09 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:10.086889 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:10.087543 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:10.094384 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:10.094820 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:10.095629 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:10.096052 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:10.236080 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:10.243808 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9c01aac0-c795-4695-8e67-a6fa0aa59086 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.161824 Jun 16 16:47:10.244395 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 351/706] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:10 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:10.332195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:10.332821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:10.340162 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:10.340498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:10.341282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:10.341705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:10.477170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:10.485743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:10.487322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:10.488472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7858a2cf-48c9-44c8-821e-5995b4bba86e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.160325 Jun 16 16:47:10.489048 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 356/707] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:10 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:11.260659 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:11.261271 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:11.268404 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:11.268893 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:11.269651 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:11.270070 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:11.403846 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:11.414560 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-cc182a49-8bec-45fd-bf2d-eb7905549c63 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.157869 Jun 16 16:47:11.415158 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 352/708] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:11 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:11.510289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:11.511211 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:11.521825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:11.522530 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:11.523524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:11.523954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:11.664673 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:11.673735 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:11.675270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:11.676441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6a74d779-607c-4210-9c70-b1ec68176e75 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.172146 Jun 16 16:47:11.677013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 357/709] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:11 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:12.433347 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:12.433966 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:12.440651 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:12.441102 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:12.441852 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:12.442279 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:12.596351 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:12.604688 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-2367ab27-687b-48f0-b6ca-36ebf59376b6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.175691 Jun 16 16:47:12.605277 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 353/710] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:12 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:12.697634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:12.698276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:12.706421 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:12.706953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:12.707967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:12.708393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:12.861006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:12.870553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:12.872083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:12.873234 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f7706d93-aa9a-4e38-8091-b6df3ff2da61 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.181440 Jun 16 16:47:12.873843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 358/711] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:12 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:13.622161 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:13.622724 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:13.629754 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:13.630200 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:13.631036 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:13.631412 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:13.778192 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:13.790568 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c18f059b-c1e0-4c23-b913-92c8e5bea339 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.172127 Jun 16 16:47:13.791536 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 354/712] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:13 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:13.893063 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:13.893655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:13.901592 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:13.901928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:13.902682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:13.903122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:14.041723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:14.054920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:14.056463 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:14.057619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a36d8eda-f38a-4ff6-96ef-1d1912d28581 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.169313 Jun 16 16:47:14.058174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 359/713] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:13 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:47:14.808979 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:14.809627 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:14.817295 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:14.817745 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:14.818516 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:14.818949 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:14.985182 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:14.993711 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-9b1c0e37-18d5-4488-a9fc-c711dd2b8d0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.189312 Jun 16 16:47:15.002921 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 355/714] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:14 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:15.076665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:15.077219 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:15.083969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:15.084413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:15.085159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:15.085638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:15.229240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:15.238573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:15.240407 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:15.241554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eb164d6e-90c6-42cf-b690-34a946273df7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.169163 Jun 16 16:47:15.242375 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 360/715] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:15 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:16.010597 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:16.011249 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:16.018250 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:16.018705 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:16.019503 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:16.019947 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:16.160526 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:16.167881 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-e1b48d1a-646d-454b-a048-5c73e500a9bd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.161950 Jun 16 16:47:16.168501 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 356/716] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:16 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:16.267938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:16.268513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:16.276815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:16.277255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:16.278009 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:16.278434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:16.422433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:16.435340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:16.437688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:16.439411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-75f5fbdf-3aed-428b-902a-9c6bfc326837 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.178017 Jun 16 16:47:16.440242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 361/717] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:16 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:16.661893 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-c71c37a6-9baf-4ceb-b97f-01b7361798e3 req-2db51df9-bd0f-4ea7-87cb-a723d61dcc42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b7f89d4-2837-48f0-854e-4267acb270bb", "name": "network-vif-plugged", "status": "completed", "tag": "6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:47:16.670541 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-c71c37a6-9baf-4ceb-b97f-01b7361798e3 req-2db51df9-bd0f-4ea7-87cb-a723d61dcc42 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:16.671025 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-c71c37a6-9baf-4ceb-b97f-01b7361798e3 req-2db51df9-bd0f-4ea7-87cb-a723d61dcc42 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:16.683700 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-c71c37a6-9baf-4ceb-b97f-01b7361798e3 req-2db51df9-bd0f-4ea7-87cb-a723d61dcc42 service nova] Creating event network-vif-plugged:6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d for instance 0b7f89d4-2837-48f0-854e-4267acb270bb on hv-cinder-83735 Jun 16 16:47:16.688729 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-c71c37a6-9baf-4ceb-b97f-01b7361798e3 req-2db51df9-bd0f-4ea7-87cb-a723d61dcc42 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Jun 16 16:47:16.689309 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 357/718] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:47:17.184835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:17.185324 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:17.187316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=54 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:17.193228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:17.193673 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:17.194426 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:17.195185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:17.338246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:17.346167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9015beb8-7b06-40d3-bbeb-b47bfbf0dcb7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1266 microversion: 2.1 time: 0.165153 Jun 16 16:47:17.346865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 362/719] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:17 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:17.461780 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:17.462519 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:17.469354 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:17.469803 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:17.470562 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:17.470995 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:17.473690 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=100 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:17.610408 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:17.619264 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:17.620758 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:17.621909 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-84dcefa8-c139-491d-9a1a-2ad3a0afc27d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.165519 Jun 16 16:47:17.622463 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 358/720] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:17 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:18.234517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:18.235001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:18.241190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.241634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.242457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.243097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.362961 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:18.363619 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:18.370121 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.370568 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.371482 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.371908 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.385726 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lazy-loading 'services' on Instance uuid 0f87cf89-85cd-463b-9477-7588d7796193 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:47:18.511229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9da1336f-55ad-47ac-b924-680199985c4c tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193/os-volume_attachments/c40628d4-6b83-489c-850e-68b959fed9a4" status: 202 len: 0 microversion: 2.1 time: 0.280426 Jun 16 16:47:18.512278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 363/721] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:47:18 2022] DELETE /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193/os-volume_attachments/c40628d4-6b83-489c-850e-68b959fed9a4 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:47:18.513902 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:18.527522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-b5d1f596-c5fd-41a1-b312-c8050de35ebd tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1453 microversion: 2.1 time: 0.168337 Jun 16 16:47:18.529068 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 359/722] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:18 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:18.545395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:18.546328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:18.553121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.553544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.554363 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.555377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.640283 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:18.640918 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:18.649328 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.650040 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.650985 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:18.651582 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:18.701394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:18.709049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a53a1fef-6c87-43dc-be07-d93c0aa6694e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1453 microversion: 2.1 time: 0.168005 Jun 16 16:47:18.709857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 364/723] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:18 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:18.798283 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:18.807220 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:18.808710 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:18.809846 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-de360696-c120-4b93-aad2-e754564e7a02 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.173467 Jun 16 16:47:18.810402 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 360/724] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:18 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:19.828861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:19.829523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:19.836359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:19.836805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:19.837576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:19.838194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:20.293946 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:20.303077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:20.304613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:20.306361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-98eece78-fd7e-45e6-a070-724ca3de02b0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.482730 Jun 16 16:47:20.306942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 365/725] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:19 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:20.741537 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-3372da1b-c02d-4f35-91b0-54168d97ca8c req-a2457e08-543c-4118-b661-2fe55c2302cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e74018d-237a-4638-972d-b5b85e487dc5", "tag": "6c3cf76d-086d-4831-b63d-173afc22d303"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:47:20.745785 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=56 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:20.751469 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-3372da1b-c02d-4f35-91b0-54168d97ca8c req-a2457e08-543c-4118-b661-2fe55c2302cf service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:20.751911 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-3372da1b-c02d-4f35-91b0-54168d97ca8c req-a2457e08-543c-4118-b661-2fe55c2302cf service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:20.763633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-3372da1b-c02d-4f35-91b0-54168d97ca8c req-a2457e08-543c-4118-b661-2fe55c2302cf service nova] Creating event network-changed:6c3cf76d-086d-4831-b63d-173afc22d303 for instance 8e74018d-237a-4638-972d-b5b85e487dc5 on hv-cinder-83735 Jun 16 16:47:20.769093 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [req-3372da1b-c02d-4f35-91b0-54168d97ca8c req-a2457e08-543c-4118-b661-2fe55c2302cf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094823 Jun 16 16:47:20.769886 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 361/726] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:47:21.331468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:21.333548 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:21.344974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:21.345835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:21.346898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:21.347421 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:21.373547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:21.503591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:21.513896 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:21.515402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:21.516565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ad04e256-4ac8-4276-9647-dc3860009c98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.190723 Jun 16 16:47:21.517632 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 366/727] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:21 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:21.764612 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:21.765223 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:21.772542 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:21.772972 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:21.774067 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:21.774522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:21.800893 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Going to try to terminate instance {{(pid=124103) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:47:21.888858 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-eaab5cca-6296-40ae-909a-70848f612092 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 204 len: 0 microversion: 2.1 time: 0.128942 Jun 16 16:47:21.889467 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 362/728] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:47:21 2022] DELETE /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:47:21.898249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:21.898866 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:21.905318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:21.905764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:21.906615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:21.907019 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:22.040610 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:22.048577 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f08cd596-d351-47b0-a33e-110af6329c56 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1514 microversion: 2.1 time: 0.154428 Jun 16 16:47:22.049162 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 367/729] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:21 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:47:22.540265 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:22.540951 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:22.547515 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:22.547951 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:22.548705 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:22.549125 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:22.683128 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:22.696553 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:22.699193 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:22.700910 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-c6ac24ce-a493-4f1e-bd63-b73159cec703 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.166995 Jun 16 16:47:22.701763 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 363/730] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:22 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:23.071101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:23.072384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:23.083913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:23.084682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:23.085994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:23.086422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:23.225910 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:23.234024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-69a9e27d-d595-4334-88c1-b9ee2f617ae4 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1514 microversion: 2.1 time: 0.169960 Jun 16 16:47:23.234601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 368/731] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:23 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:23.725826 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:23.726531 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:23.733946 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:23.734500 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:23.735340 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:23.735784 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:23.879673 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:23.888818 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:23.890351 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:23.891410 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-73d7c514-9857-4056-86c4-9ddcb77f1d8b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1808 microversion: 2.20 time: 0.169628 Jun 16 16:47:23.896511 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 364/732] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:23 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:24.255909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:24.256882 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:24.268593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:24.269338 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:24.270575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:24.271362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:24.410050 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:24.418089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3d2ec90f-d814-4d8a-8109-6484bb1d9798 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1514 microversion: 2.1 time: 0.168755 Jun 16 16:47:24.418798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 369/733] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:24 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1514 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:24.911531 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:24.912074 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.compute.api [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124103) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:24.919217 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:24.919664 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:24.920415 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:24.920841 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:25.167895 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:25.176982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:25.178754 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.policy [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124103) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:25.180365 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.requestlog [None req-fcb86ad5-5f49-4931-baae-b92e4faa64b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1795 microversion: 2.20 time: 0.272804 Jun 16 16:47:25.180780 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: [pid: 124103|app: 0|req: 365/734] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:47:24 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1795 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:47:25.436710 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:25.437315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:25.445452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:25.445624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:25.446443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:25.446835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:25.449248 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG nova.api.openstack.wsgi [req-274b7575-3ca6-4c29-bef8-4c2dd6544f14 req-75ea9e8d-eda1-4aa4-b7d6-01c122767881 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f87cf89-85cd-463b-9477-7588d7796193", "name": "network-vif-deleted", "tag": "fdf23c85-d361-4506-aff9-8bf4208dc2a3"}]} {{(pid=124103) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:47:25.457807 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-274b7575-3ca6-4c29-bef8-4c2dd6544f14 req-75ea9e8d-eda1-4aa4-b7d6-01c122767881 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:25.458238 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG oslo_concurrency.lockutils [req-274b7575-3ca6-4c29-bef8-4c2dd6544f14 req-75ea9e8d-eda1-4aa4-b7d6-01c122767881 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124103) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:25.469796 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO nova.api.openstack.compute.server_external_events [req-274b7575-3ca6-4c29-bef8-4c2dd6544f14 req-75ea9e8d-eda1-4aa4-b7d6-01c122767881 service nova] Creating event network-vif-deleted:fdf23c85-d361-4506-aff9-8bf4208dc2a3 for instance 0f87cf89-85cd-463b-9477-7588d7796193 on hv-cinder-83735 Jun 16 16:47:25.473551 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:47:25.474996 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:47:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:47:25.492414 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Traceback (most recent call last): Jun 16 16:47:25.492633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 16 16:47:25.492633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: timer() Jun 16 16:47:25.492633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 16 16:47:25.492633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: cb(*args, **kw) Jun 16 16:47:25.492633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 16 16:47:25.492633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: waiter.switch() Jun 16 16:47:25.492633 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: greenlet.error: cannot switch to a different thread Jun 16 16:47:25.515839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797350f034d24e7580beeb67e6693a53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb9beb4baa2b41808ba9ffa5f233ae48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:25.524771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6b0693d8-25d6-46b7-abfe-5a5e8bf10e9e tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 200 len: 1472 microversion: 2.1 time: 0.092383 Jun 16 16:47:25.534397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 370/735] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:25 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 1472 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:26.547338 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:26.548392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] [instance: 0f87cf89-85cd-463b-9477-7588d7796193] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:26.557974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:26.558417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:26.559211 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:26.559633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:26.573887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] HTTP exception thrown: Instance 0f87cf89-85cd-463b-9477-7588d7796193 could not be found. Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Request method failure captured: Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 HTTP/1.1 Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq13VZv8C3BHAc5LQOQoTRXTaPhsmMI-QQLSY-M7ijS_GoKjD9YkAKIgevyEZmfQC3WkztoEwk_vMu7UAvYakSxTBa-H1vgpyKgz2BgT27q7_gCX0LdpN1ggSOZr5KzT6XAggoFDy2Qn95okfDtBFIR5Z43ENRaFEkCe7C1ThWbh31k4 Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: eb9beb4baa2b41808ba9ffa5f233ae48 Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1446814356 Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:47:26.575561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_eb9beb4baa2b41808ba9ffa5f233ae48"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesSnapshotTestJSON-1446814356 Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: eb9beb4baa2b41808ba9ffa5f233ae48 Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1446814356 Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesSnapshotTestJSON-1446814356-project Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 797350f034d24e7580beeb67e6693a53 Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesSnapshotTestJSON-1446814356-project Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0f87cf89-85cd-463b-9477-7588d7796193 could not be found. Jun 16 16:47:26.577207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0f87cf89-85cd-463b-9477-7588d7796193'} Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f87cf89-85cd-463b-9477-7588d7796193 could not be found. Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:47:26.578083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f87cf89-85cd-463b-9477-7588d7796193 could not be found. Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f87cf89-85cd-463b-9477-7588d7796193 could not be found. Jun 16 16:47:26.579433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:47:26.580554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] Returning 404 to user: Instance 0f87cf89-85cd-463b-9477-7588d7796193 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:47:26.580554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eebd7dab-5f5d-4bfe-926b-38881fbfbc83 tempest-VolumesSnapshotTestJSON-1446814356 tempest-VolumesSnapshotTestJSON-1446814356-project] 10.222.0.74 "GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193" status: 404 len: 111 microversion: 2.1 time: 0.036085 Jun 16 16:47:26.580554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 371/736] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:26 2022] GET /compute/v2.1/servers/0f87cf89-85cd-463b-9477-7588d7796193 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:47:35.454982 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:35.462712 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: DEBUG dbcounter [-] [124103] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:55.321845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=19 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:55.322698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=31 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:47:55.499180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:47:55.499717 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:55.506093 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:55.506537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:55.507380 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:55.507807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:55.533007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lazy-loading 'flavor' on Instance uuid 102aa75e-21d3-415e-9a04-d44e46ca9308 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:47:55.661729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eb1530ed-097f-4a99-9426-857521745ebe tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "POST /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308/action" status: 202 len: 0 microversion: 2.1 time: 0.345167 Jun 16 16:47:55.662699 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 372/737] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:47:55 2022] POST /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:47:55.671882 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:55.672747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:55.679349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:55.679820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:55.680694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:55.681261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:55.819758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:55.828098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-41b20d6b-615d-4677-9724-4ec0bbb1e494 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.161134 Jun 16 16:47:55.828685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 373/738] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:55 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:47:56.849947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:56.850937 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:56.862650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:56.863467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:56.864906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:56.865621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:57.017985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:57.028910 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-579c175f-93cd-468c-aa2e-80f6b9944fda tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.185698 Jun 16 16:47:57.029511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 374/739] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:56 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:58.047493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:58.048217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:58.055247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:58.055696 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:58.056470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:58.056897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:58.242562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:58.251622 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5fde951a-7374-46da-bfc4-99c830d436ab tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.208793 Jun 16 16:47:58.252225 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 375/740] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:58 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:47:59.274775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:47:59.275469 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:47:59.283789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:59.284214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:59.284987 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:47:59.285415 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:47:59.429441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:47:59.441395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-28aa4672-ab21-4ea8-9ee0-0f26e63f8c38 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.172088 Jun 16 16:47:59.442480 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 376/741] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:47:59 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:00.469073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:00.469873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:00.477294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:00.477742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:00.478507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:00.478922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:00.624802 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:00.634561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-902b4a1d-1adc-4b03-b567-c5c0c2610afb tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.169815 Jun 16 16:48:00.635177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 377/742] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:00 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:01.652597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:01.653267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:01.660117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:01.660564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:01.661285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:01.661720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:01.806991 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:01.815007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1e9e9207-dd4c-4a94-93d5-33eb8ceff81f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.166662 Jun 16 16:48:01.815596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 378/743] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:01 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:02.834214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:02.834898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:02.842065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:02.842524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:02.843316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:02.843783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:02.992185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:03.000414 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0db59f9e-c94d-41c4-880f-def8e025afae tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.170372 Jun 16 16:48:03.000965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 379/744] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:02 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:04.026055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:04.026915 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:04.036038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:04.036686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:04.037570 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:04.038181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:04.185635 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:04.196179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f4ac68b8-3a2b-4a59-b571-cf7f7b02b764 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.176769 Jun 16 16:48:04.196785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 380/745] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:04 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:05.218183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:05.218887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:05.225790 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:05.226239 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:05.227281 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:05.227709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:05.373506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:05.384312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bd04f017-aa09-4566-a90f-4fa3c23e79bd tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.169771 Jun 16 16:48:05.385505 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 381/746] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:05 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:06.405345 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:06.406200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:06.415919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:06.416357 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:06.417109 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:06.417527 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:06.563558 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:06.571960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7cf06378-8313-4d96-aec7-ce4371b219d8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.172943 Jun 16 16:48:06.572541 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 382/747] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:06 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:07.589247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:07.589838 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:07.597099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:07.597535 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:07.598281 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:07.598711 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:07.753359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:07.761848 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-be6cec0d-d564-402b-9158-f62d190bf619 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.176604 Jun 16 16:48:07.762422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 383/748] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:07 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:08.781477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:08.782382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:08.790912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:08.791398 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:08.792146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:08.792559 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:08.937802 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:08.949390 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-81ce509c-a257-4cc1-9452-b6e6b8bca709 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.172777 Jun 16 16:48:08.950091 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 384/749] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:08 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:09.972759 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:09.973629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:09.983271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:09.983904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:09.984953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:09.985626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:10.129105 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:10.136743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ae2ca007-8000-4bcb-9ad6-cf4722878969 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.169366 Jun 16 16:48:10.137289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 385/750] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:09 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:11.154635 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:11.155340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:11.162247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:11.162692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:11.163478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:11.163901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:11.182545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:48:11.303972 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:11.311724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-04e94fe5-f656-48cd-883e-f8efb2c4f624 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.161031 Jun 16 16:48:11.312295 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 386/751] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:11 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:12.329589 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:12.330252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:12.337069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:12.337512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:12.338270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:12.338702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:12.480599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:12.488949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-be6fa711-2f75-49b4-8c18-ae4dbff50449 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.163336 Jun 16 16:48:12.489529 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 387/752] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:12 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:13.512158 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:13.512862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:13.521691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:13.522140 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:13.522886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:13.523336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:13.671801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:13.683327 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-20a79651-e977-4e1e-98b1-79a71a639680 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.177234 Jun 16 16:48:13.683926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 388/753] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:13 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:14.701500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:14.702179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:14.709131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:14.709575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:14.710336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:14.710761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:14.844930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:14.852834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8c1c7954-68fa-4d98-bd78-c492985849f6 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.155255 Jun 16 16:48:14.853419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 389/754] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:14 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:15.870835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:15.871579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:15.879545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:15.879991 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:15.880768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:15.881186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:16.042526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:16.051302 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-38d03907-5b92-4a65-82db-78e7fd5f6c5b tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.184882 Jun 16 16:48:16.051883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 390/755] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:15 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:17.069384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:17.070024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:17.078044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:17.078572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:17.080312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:17.080312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:17.218569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:17.226337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e6a6be40-c252-4ea3-b6c8-061d24051db7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.161262 Jun 16 16:48:17.226931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 391/756] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:17 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:18.247628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:18.248668 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:18.255288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:18.255887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:18.256702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:18.257126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:18.410565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:18.419648 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dd3aa6f9-f8ca-4176-93f3-e5739e9de664 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.179966 Jun 16 16:48:18.433143 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 392/757] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:18 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:19.437992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:19.438677 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:19.447329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:19.448030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:19.449630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:19.450277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:19.600072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:19.608245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9caee8a6-1391-465c-bc2a-a7d9939dc6c7 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.174902 Jun 16 16:48:19.608820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 393/758] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:19 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:20.627177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:20.627856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:20.634707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:20.635177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:20.635933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:20.636434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:20.785212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:20.796987 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5ca64146-89b3-4e87-aa60-2d04cf519f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.174534 Jun 16 16:48:20.797503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 394/759] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:20 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:21.814230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:21.814928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:21.821467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:21.821897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:21.822644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:21.823077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:21.971743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:21.979874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a704d275-a062-4e7f-8a21-db9ec6f81a29 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1570 microversion: 2.1 time: 0.169833 Jun 16 16:48:21.980788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 395/760] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:21 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:21.997313 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5c78c525-0fc9-4f1f-921a-70de1edbe77e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:21.997882 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5c78c525-0fc9-4f1f-921a-70de1edbe77e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:22.004303 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5c78c525-0fc9-4f1f-921a-70de1edbe77e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:22.004996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5c78c525-0fc9-4f1f-921a-70de1edbe77e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:22.005525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5c78c525-0fc9-4f1f-921a-70de1edbe77e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:22.006169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5c78c525-0fc9-4f1f-921a-70de1edbe77e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:22.154275 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5c78c525-0fc9-4f1f-921a-70de1edbe77e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "POST /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308/action" status: 202 len: 0 microversion: 2.1 time: 0.161598 Jun 16 16:48:22.157980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 396/761] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:48:21 2022] POST /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:48:22.162923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:22.163563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:22.170354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:22.170519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:22.171294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:22.171713 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:22.354442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:22.366681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-107f10f8-5054-44e1-bc00-6549cdca59bc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1518 microversion: 2.1 time: 0.207445 Jun 16 16:48:22.367817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 397/762] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:22 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1518 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:22.904619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-68c8e460-a6e4-421c-9a5c-ec3c227bbd00 req-79c21d7f-1060-4a6d-890c-a602b28e302b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102aa75e-21d3-415e-9a04-d44e46ca9308", "name": "network-vif-unplugged", "status": "completed", "tag": "67748224-b4d4-4324-99dd-41ee8f120ef2"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:22.914669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-68c8e460-a6e4-421c-9a5c-ec3c227bbd00 req-79c21d7f-1060-4a6d-890c-a602b28e302b service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:22.921569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-68c8e460-a6e4-421c-9a5c-ec3c227bbd00 req-79c21d7f-1060-4a6d-890c-a602b28e302b service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:22.933949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.compute.server_external_events [req-68c8e460-a6e4-421c-9a5c-ec3c227bbd00 req-79c21d7f-1060-4a6d-890c-a602b28e302b service nova] Unable to find a host for instance 102aa75e-21d3-415e-9a04-d44e46ca9308. Dropping event network-vif-unplugged {{(pid=124104) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 16:48:22.934842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-68c8e460-a6e4-421c-9a5c-ec3c227bbd00 req-79c21d7f-1060-4a6d-890c-a602b28e302b service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036143 Jun 16 16:48:22.935483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 398/763] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:48:22 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 16 16:48:23.461381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f526aced-ecd0-4dc5-9c02-a7e99d5696e4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5fa6580-7a54-4c09-8ff7-7fe10f2c4c29"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:23.462462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f526aced-ecd0-4dc5-9c02-a7e99d5696e4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:23.469104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f526aced-ecd0-4dc5-9c02-a7e99d5696e4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:23.469550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f526aced-ecd0-4dc5-9c02-a7e99d5696e4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:23.470303 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f526aced-ecd0-4dc5-9c02-a7e99d5696e4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:23.470732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f526aced-ecd0-4dc5-9c02-a7e99d5696e4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:23.753943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f526aced-ecd0-4dc5-9c02-a7e99d5696e4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.419894 Jun 16 16:48:23.754493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 399/764] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:48:23 2022] POST /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments => generated 194 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:48:23.759725 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:23.760389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:23.768177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:23.768852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:23.770141 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:23.770689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:23.912940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:23.921180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7ca1cf07-22d8-4307-b825-7cae7bdd4c5d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1520 microversion: 2.1 time: 0.165509 Jun 16 16:48:23.921778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 400/765] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:23 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:24.939582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:24.940262 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:24.946861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:24.947341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:24.948091 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:24.948512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:24.966998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:48:25.091617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:25.099873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7db70853-81ae-4070-9c91-05e86bcb5683 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.164579 Jun 16 16:48:25.100502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 401/766] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:24 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:26.121032 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:26.122103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:26.126193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=63 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:48:26.135202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:26.135949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:26.137209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:26.137924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:26.286256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:26.297420 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dfee044e-6f45-4ba3-81cf-735d516e9aea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.182852 Jun 16 16:48:26.298006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 402/767] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:26 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:27.319024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:27.320203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:27.331461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:27.332188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:27.333445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:27.334150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:27.473728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:27.481864 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7dffa880-de80-4c2e-a655-acfd15344bfc tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.169480 Jun 16 16:48:27.482449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 403/768] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:27 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:28.503919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:28.505036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:28.515565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:28.516010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:28.516778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:28.517208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:28.657354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:28.664922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b9cd8d85-7ba8-4f47-8d4d-521accff6d04 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.168283 Jun 16 16:48:28.665498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 404/769] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:28 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:29.686684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:29.687368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:29.694294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:29.694735 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:29.695628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:29.696049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:29.853055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:29.862618 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-186b8b0b-0178-4fd6-ac2a-ef5c5fc4ccb9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.182826 Jun 16 16:48:29.863221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 405/770] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:29 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:30.880784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:30.881491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:30.888411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:30.888857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:30.890142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:30.890575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:31.039355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:31.047471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-64426341-1392-4480-82da-36ffde54702c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.170748 Jun 16 16:48:31.048093 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 406/771] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:30 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:32.065748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:32.066461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:32.073311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:32.073765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:32.074546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:32.074952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:32.226603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:32.237066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bc00e0b2-0ea4-47ae-91c8-3eb09491a45f tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.175441 Jun 16 16:48:32.237637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 407/772] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:32 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:32.369582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:32.371017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:32.378528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:32.378954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:32.379914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:32.380251 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:32.403397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lazy-loading 'flavor' on Instance uuid 76def3bd-d733-4708-adad-1e7e7d17a584 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:48:32.536402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9ee2b1a1-0c9d-4e6b-b9cf-4a8085bd3699 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/action" status: 200 len: 32 microversion: 2.1 time: 0.173457 Jun 16 16:48:32.537081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 408/773] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:48:32 2022] POST /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:48:32.547135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:32.547840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:32.554413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:32.554864 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:32.555956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:32.556385 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:32.692328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:32.703653 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d78240b2-066a-4391-90ce-9c2509f46720 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.161247 Jun 16 16:48:32.704423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 409/774] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:32 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:33.255018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:33.255768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:33.262943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:33.263413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:33.264170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:33.264613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:33.408069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:33.416013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8aa4464e-04fb-45e4-85e8-80445e88ef5c tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.164936 Jun 16 16:48:33.416552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 410/775] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:33 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:33.721660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:33.722295 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:33.729149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:33.729596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:33.730361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:33.730791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:33.863826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:33.872988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e43d1733-71cd-459b-8c60-508d8d46338e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.155471 Jun 16 16:48:33.873575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 411/776] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:33 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:34.438148 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:34.439273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:34.450193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:34.450926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:34.452251 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:34.452704 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:34.602182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:34.610672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-df16bfae-cb02-43ff-869b-0a2c27cfba4e tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.179458 Jun 16 16:48:34.611249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 412/777] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:34 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:34.890295 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:34.890900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:34.897707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:34.898151 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:34.898905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:34.899367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:35.028687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:35.036946 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b3e7b222-1961-4fb2-81a9-c1bdb351bbbe tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.150799 Jun 16 16:48:35.037573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 413/778] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:34 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:35.627747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:35.628451 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:35.635328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:35.635764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:35.636511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:35.636936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:35.777099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:35.785379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f2530d58-63e0-456d-9336-4c240f505ef8 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.161621 Jun 16 16:48:35.785930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 414/779] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:35 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:36.058939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:36.060046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:36.070397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:36.071153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:36.072434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:36.073137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:36.216353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:36.227090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b928a22c-3530-4bc9-abcf-6cdb37dfa21e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.174610 Jun 16 16:48:36.227846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 415/780] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:36 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:36.806807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:36.807886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:36.819033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:36.819817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:36.821035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:36.821739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:36.828166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:48:36.964078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:36.972650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-29af6d8b-b0db-418e-9fca-9e235c74c1a2 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.172399 Jun 16 16:48:36.973236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 416/781] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:36 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:37.250989 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:37.251925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:37.258320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:37.258761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:37.259563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:37.259987 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:37.396838 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:37.405893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-14f19a1e-481b-416a-b814-6b0e4114ceeb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.159142 Jun 16 16:48:37.406702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 417/782] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:37 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:37.414881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-470e9c84-93cf-4288-9857-5f25649a2304 req-75a63038-d80b-4d45-8ec3-4c2308732190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102aa75e-21d3-415e-9a04-d44e46ca9308", "name": "network-vif-plugged", "status": "completed", "tag": "67748224-b4d4-4324-99dd-41ee8f120ef2"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:37.423670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-470e9c84-93cf-4288-9857-5f25649a2304 req-75a63038-d80b-4d45-8ec3-4c2308732190 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:37.424166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-470e9c84-93cf-4288-9857-5f25649a2304 req-75a63038-d80b-4d45-8ec3-4c2308732190 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:37.435721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-470e9c84-93cf-4288-9857-5f25649a2304 req-75a63038-d80b-4d45-8ec3-4c2308732190 service nova] Creating event network-vif-plugged:67748224-b4d4-4324-99dd-41ee8f120ef2 for instance 102aa75e-21d3-415e-9a04-d44e46ca9308 on hv-cinder-83735 Jun 16 16:48:37.440736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-470e9c84-93cf-4288-9857-5f25649a2304 req-75a63038-d80b-4d45-8ec3-4c2308732190 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029968 Jun 16 16:48:37.441320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 418/783] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:48:37.990935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:37.991634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:37.998408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:37.998863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:37.999730 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:38.000172 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:38.143605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:38.151905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d1c16195-2912-4a5c-8220-824418d06192 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.165664 Jun 16 16:48:38.152457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 419/784] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:37 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:38.423415 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:38.424243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:38.430488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:38.430923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:38.431708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:38.432121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:38.561944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:38.570574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a5d07006-c61f-486a-94c9-c3698438d71a tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.151138 Jun 16 16:48:38.571205 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 420/785] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:38 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:39.168733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:39.169553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:39.176426 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:39.176875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:39.177744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:39.178162 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:39.322476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:39.334615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-317f300c-cea7-4e54-beec-c0840dd7281d tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1576 microversion: 2.1 time: 0.169640 Jun 16 16:48:39.335536 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 421/786] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:39 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:39.589021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:39.589702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:39.596662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:39.597102 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:39.597848 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:39.598271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:39.745493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:39.754247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc21f885-782c-41a7-a3ee-8f67fa14dc5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.169526 Jun 16 16:48:39.754818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 422/787] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:39 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:40.359706 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:40.360508 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:40.368817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:40.369628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:40.370071 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:40.370545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:40.512758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:40.521753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-da680418-1a16-4f2d-b387-1674e8feccea tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1563 microversion: 2.1 time: 0.167843 Jun 16 16:48:40.522314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 423/788] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:40 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:40.772161 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:40.772800 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:40.779386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:40.779832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:40.780642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:40.781078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:40.915850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:40.924596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-31c2b8ff-47aa-4114-8134-17a51352275c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.156679 Jun 16 16:48:40.925200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 424/789] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:40 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:41.945594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:41.946644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:41.954760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:41.955358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:41.956217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:41.956737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.092146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:42.101043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e59f3a52-99f4-48f6-a932-6452af5a60eb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.162290 Jun 16 16:48:42.101631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 425/790] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:41 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:42.384474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6b7d5d0d-ce38-4c37-98a6-7c9fb920d475 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:42.384959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6b7d5d0d-ce38-4c37-98a6-7c9fb920d475 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:42.391643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b7d5d0d-ce38-4c37-98a6-7c9fb920d475 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.392080 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b7d5d0d-ce38-4c37-98a6-7c9fb920d475 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.392840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b7d5d0d-ce38-4c37-98a6-7c9fb920d475 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.393261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b7d5d0d-ce38-4c37-98a6-7c9fb920d475 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.417854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6b7d5d0d-ce38-4c37-98a6-7c9fb920d475 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732/ips" status: 200 len: 149 microversion: 2.1 time: 0.037228 Jun 16 16:48:42.418434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 426/791] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:48:42 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:48:42.430277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c48fac7d-508b-4086-896c-d5c8d5f819e0"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:42.431354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:42.437874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.438310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.439088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.439532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.524947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Invalid volume: volume c48fac7d-508b-4086-896c-d5c8d5f819e0 is already attached to instances: a54ec605-c392-472a-a282-72b1631a9f92 Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: POST /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732/os-volume_attachments HTTP/1.1 Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 74 Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:48:42.527008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {"volumeAttachment": {"volumeId": "c48fac7d-508b-4086-896c-d5c8d5f819e0"}} Jun 16 16:48:42.529528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Invalid volume: volume c48fac7d-508b-4086-896c-d5c8d5f819e0 is already attached to instances: a54ec605-c392-472a-a282-72b1631a9f92 Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'server_id': '0e903d6b-31ee-4c6b-be7b-35b5aeeeb732', 'body': {'volumeAttachment': {'volumeId': 'c48fac7d-508b-4086-896c-d5c8d5f819e0'}}} Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c48fac7d-508b-4086-896c-d5c8d5f819e0 is already attached to instances: a54ec605-c392-472a-a282-72b1631a9f92 Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:42.531013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c48fac7d-508b-4086-896c-d5c8d5f819e0 is already attached to instances: a54ec605-c392-472a-a282-72b1631a9f92 Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:42.533094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c48fac7d-508b-4086-896c-d5c8d5f819e0 is already attached to instances: a54ec605-c392-472a-a282-72b1631a9f92 Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 400 to user: Invalid volume: volume c48fac7d-508b-4086-896c-d5c8d5f819e0 is already attached to instances: a54ec605-c392-472a-a282-72b1631a9f92 {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f424d589-6110-47ee-a07b-ec540f59e94e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102064 Jun 16 16:48:42.535506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 427/792] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:48:42 2022] POST /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:48:42.537688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:42.538185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:42.547579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.548332 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.549605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.550339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.577256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:48:42.659645 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ac2c885d-1519-4c17-b347-160696966c56 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 204 len: 0 microversion: 2.1 time: 0.125140 Jun 16 16:48:42.660188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 428/793] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:48:42 2022] DELETE /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:48:42.670914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:42.671980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:42.678644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.679120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.679905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:42.680310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:42.828239 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:42.836132 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a65a2322-332d-437a-aa0c-bc6949f4f00b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1682 microversion: 2.1 time: 0.171047 Jun 16 16:48:42.836742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 429/794] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:42 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:43.119366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:43.120113 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:43.127408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:43.127856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:43.128627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:43.129057 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:43.272787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:43.281693 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7628d923-9412-448b-8d89-68919f30e4d6 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.166304 Jun 16 16:48:43.282256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 430/795] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:43 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:43.854389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:43.854996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:43.862242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:43.862697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:43.863536 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:43.863968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:44.001828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:44.013829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cf8733bc-3cc8-4fdb-80d1-712a461f7fb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1682 microversion: 2.1 time: 0.163368 Jun 16 16:48:44.014554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 431/796] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:43 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:44.299831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:44.300561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:44.307126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:44.307598 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:44.308353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:44.308751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:44.313731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:48:44.451613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:44.460206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9c4f4f43-024d-493e-b92d-f9ef9b460ed5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.164411 Jun 16 16:48:44.460791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 432/797] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:44 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:45.032773 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:45.033348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:45.039802 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:45.040230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:45.041008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:45.041417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:45.193812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:45.201724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bdf8b1c7-c6e9-40de-b04f-76c69df55970 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1682 microversion: 2.1 time: 0.173097 Jun 16 16:48:45.202689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 433/798] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:45 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:45.479384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:45.480059 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:45.487474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:45.488072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:45.488851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:45.489282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:45.682741 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:45.696023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4e266b37-f251-47e3-8231-fdea026bdf32 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.221181 Jun 16 16:48:45.696775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 434/799] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:45 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:46.224004 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:46.225093 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:46.236611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:46.237136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:46.238453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:46.239194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:46.296124 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:46.297051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:46.297775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lazy-loading 'fault' on Instance uuid 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:48:46.349977 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:46.363354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-24d004c8-ce53-4b18-b8db-acf7b927de47 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 200 len: 1332 microversion: 2.1 time: 0.146397 Jun 16 16:48:46.364725 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 435/800] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:46 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 1332 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:46.730557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:46.731749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:46.741837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:46.742429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:46.743475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:46.744070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:46.993950 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:47.009397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c418dcdb-f9b9-4cd3-b493-6a9ef5d09ba0 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.286361 Jun 16 16:48:47.010392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 436/801] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:46 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:47.382177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:47.382888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:47.389255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:47.391308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:47.391308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:47.391308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:47.406751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 HTTP/1.1 Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:48:47.408512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:48:47.411382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0e903d6b-31ee-4c6b-be7b-35b5aeeeb732'} Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:48:47.413523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:48:47.416362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:47.419431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:48:47.419431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b5698d88-5fc5-46f2-97b7-399341953147 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 404 len: 111 microversion: 2.1 time: 0.032209 Jun 16 16:48:47.419431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 437/802] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:47 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:48:47.419431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-beb9d7be-ea49-479c-ac7d-3ea40b7b3e9e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '.version_select at 0x7fe5f8a6c310>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:47.444250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-beb9d7be-ea49-479c-ac7d-3ea40b7b3e9e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099145403" status: 202 len: 0 microversion: 2.1 time: 0.029156 Jun 16 16:48:47.445079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 438/803] 10.222.0.74 () {58 vars in 1220 bytes} [Thu Jun 16 16:48:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099145403 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:48:48.036769 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:48.037878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:48.049737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:48.050493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:48.051919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:48.052713 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:48.209843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:48.224513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3c5cc7fa-b70a-406a-88d2-0a86ec34daac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.193951 Jun 16 16:48:48.225590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 439/804] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:48 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:48.233699 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:48.234936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:48.241629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:48.242106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:48.242968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:48.243579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:48.326663 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lazy-loading 'services' on Instance uuid a54ec605-c392-472a-a282-72b1631a9f92 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:48:48.403680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-afd888ca-0790-4b73-bfd3-f2277765588a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments/c48fac7d-508b-4086-896c-d5c8d5f819e0" status: 202 len: 0 microversion: 2.1 time: 0.176245 Jun 16 16:48:48.404282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 440/805] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:48:48 2022] DELETE /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments/c48fac7d-508b-4086-896c-d5c8d5f819e0 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:48:48.417921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3831fb17-ad00-4049-8a1d-a291b4ba461e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:48.420135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3831fb17-ad00-4049-8a1d-a291b4ba461e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:48.430357 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3831fb17-ad00-4049-8a1d-a291b4ba461e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:48.430859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3831fb17-ad00-4049-8a1d-a291b4ba461e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:48.432078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3831fb17-ad00-4049-8a1d-a291b4ba461e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:48.432721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3831fb17-ad00-4049-8a1d-a291b4ba461e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:48.484573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3831fb17-ad00-4049-8a1d-a291b4ba461e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072928 Jun 16 16:48:48.485313 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 441/806] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:48:48 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:48:49.243872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:49.244820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:49.251465 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.251898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.252667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.253091 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.420570 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:49.432135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-afc5299d-6f8d-4ad6-bd68-b6db42ae378b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.191885 Jun 16 16:48:49.433088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 442/807] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:49 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:49.498112 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-38ac2925-e4e5-47d6-8798-aa46685c8d80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:49.499422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-38ac2925-e4e5-47d6-8798-aa46685c8d80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:49.506232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38ac2925-e4e5-47d6-8798-aa46685c8d80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.506681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38ac2925-e4e5-47d6-8798-aa46685c8d80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.507484 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38ac2925-e4e5-47d6-8798-aa46685c8d80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.507915 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-38ac2925-e4e5-47d6-8798-aa46685c8d80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.539639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-38ac2925-e4e5-47d6-8798-aa46685c8d80 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045510 Jun 16 16:48:49.540221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 443/808] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:48:49 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:48:49.600056 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:49.600545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:49.606781 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.607272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.608019 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.609106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.634533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:48:49.712025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:48:49.724086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-31c6796b-5a23-4b0b-81f9-b50b48973756 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 204 len: 0 microversion: 2.1 time: 0.127579 Jun 16 16:48:49.725348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 444/809] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:48:49 2022] DELETE /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:48:49.735448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:49.736413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:49.744081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.744539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.745268 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:49.745697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:49.877779 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:49.885410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-51334bf4-11f8-47b3-b1a7-89b0bfd4c0b7 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1681 microversion: 2.1 time: 0.155298 Jun 16 16:48:49.885978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 445/810] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:49 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:50.450288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:50.450981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:50.457967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:50.458412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:50.459194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:50.459623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:50.594580 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:50.603096 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc1abe4d-3169-4a51-8557-1a4e14f1dcdf tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.156781 Jun 16 16:48:50.603725 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 446/811] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:50 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:50.906356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:50.906881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:50.913098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:50.913539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:50.914293 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:50.914722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:51.049267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:51.052753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:48:51.057785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9aeeaece-bb85-490f-804f-992b17c2176f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1681 microversion: 2.1 time: 0.155890 Jun 16 16:48:51.058368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 447/812] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:50 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:51.620989 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:51.621762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:51.630182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:51.630616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:51.631485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:51.631909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:51.766474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:51.775401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3895465c-9757-4204-a478-87e6227fa13e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.158477 Jun 16 16:48:51.775990 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 448/813] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:51 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:52.076617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:52.077168 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:52.084186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:52.084635 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:52.085402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:52.085829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:52.226217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:52.233960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2ba176a7-f605-41bd-9f44-d5256d379d65 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1681 microversion: 2.1 time: 0.161417 Jun 16 16:48:52.234753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 449/814] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:52 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:52.799729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:52.800513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:52.808531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:52.809013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:52.809899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:52.810453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:52.974588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:52.984220 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-299439f0-0200-4cd0-9ccb-cbfc70bbeeb7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.189049 Jun 16 16:48:52.984572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 450/815] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:52 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:53.253513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:53.254330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:53.262528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:53.263346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:53.264731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:53.265568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:53.374063 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:53.385339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7cfa42cf-d280-4eed-9a06-74a7a7525f59 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1614 microversion: 2.1 time: 0.136707 Jun 16 16:48:53.388510 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 451/816] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:53 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1614 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:54.001159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:54.001928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:54.008911 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:54.009432 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:54.010241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:54.010685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:54.156316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:54.164904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d15d2d35-72fc-407e-b1c4-a67462654b41 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1733 microversion: 2.1 time: 0.167661 Jun 16 16:48:54.165472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 452/817] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:53 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1733 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:54.403199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:54.403920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:54.410808 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:54.411556 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:54.412837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:54.413349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:54.447554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:54.447984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:54.448427 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lazy-loading 'fault' on Instance uuid a54ec605-c392-472a-a282-72b1631a9f92 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:48:54.509525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:54.517887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cd554ef7-f576-4c8f-a7c0-3b0c59a7bdd1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 200 len: 1331 microversion: 2.1 time: 0.118678 Jun 16 16:48:54.518480 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 453/818] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:54 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 1331 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:55.188990 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:55.191320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:55.203174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.203944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.205300 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.206041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.411821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:55.420159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b2c7b046-fe2b-4ef3-b3a5-a45d52010939 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1713 microversion: 2.1 time: 0.239733 Jun 16 16:48:55.420715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 454/819] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:55 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1713 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:55.484549 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:55.485033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:55.491448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.491894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.492649 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.493083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.577185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] HTTP exception thrown: Cannot 'detach_volume' instance 76def3bd-d733-4708-adad-1e7e7d17a584 while it is in vm_state rescued Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Request method failure captured: Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments/f5fa6580-7a54-4c09-8ff7-7fe10f2c4c29 HTTP/1.1 Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq11ro5b6A7FX6ganUFkpAtzCii9mMuj67uU_EJNeKXyOVPEi11CdokpdBemuXsxHJ3EWXeF6Gk6i83UtOmjUgKcNggIs7XNblR-5bgNopCBBFauzxp28j6cQ1iAIDY97oyTWK_pk6Wim5GNajqAEYXr3_6QO1M8H2BAoUD6g3UGqsMo Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:48:55.579445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 86f1f2722c5c4da59fd83036ce1700e1 Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:48:55.581229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Cannot 'detach_volume' instance 76def3bd-d733-4708-adad-1e7e7d17a584 while it is in vm_state rescued Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'server_id': '76def3bd-d733-4708-adad-1e7e7d17a584', 'id': 'f5fa6580-7a54-4c09-8ff7-7fe10f2c4c29'} Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 76def3bd-d733-4708-adad-1e7e7d17a584 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:48:55.582198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 76def3bd-d733-4708-adad-1e7e7d17a584 while it is in vm_state rescued Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 76def3bd-d733-4708-adad-1e7e7d17a584 while it is in vm_state rescued Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.583942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Returning 409 to user: Cannot 'detach_volume' instance 76def3bd-d733-4708-adad-1e7e7d17a584 while it is in vm_state rescued {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:48:55.586795 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3b356807-c82c-4021-9be5-48546643b606 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "DELETE /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments/f5fa6580-7a54-4c09-8ff7-7fe10f2c4c29" status: 409 len: 152 microversion: 2.1 time: 0.100659 Jun 16 16:48:55.586795 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 455/820] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:48:55 2022] DELETE /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments/f5fa6580-7a54-4c09-8ff7-7fe10f2c4c29 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 16 16:48:55.586795 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:55.587349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:55.595468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.596248 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.597600 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.598393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.616192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 HTTP/1.1 Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:48:55.618245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:48:55.619829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'a54ec605-c392-472a-a282-72b1631a9f92'} Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:48:55.620688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:48:55.622034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:48:55.623389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:48:55.623389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-80358a39-f00c-4d91-9c03-1722eb32822e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 404 len: 111 microversion: 2.1 time: 0.038115 Jun 16 16:48:55.623389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 456/821] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:55 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:48:55.628731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a906d114-846c-4ed1-8993-5d2482cdef5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:55.629250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a906d114-846c-4ed1-8993-5d2482cdef5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:55.635468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a906d114-846c-4ed1-8993-5d2482cdef5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.635927 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a906d114-846c-4ed1-8993-5d2482cdef5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.636702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a906d114-846c-4ed1-8993-5d2482cdef5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.637130 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a906d114-846c-4ed1-8993-5d2482cdef5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.706285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a906d114-846c-4ed1-8993-5d2482cdef5e tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "POST /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/action" status: 202 len: 0 microversion: 2.1 time: 0.081301 Jun 16 16:48:55.707014 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 457/822] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:48:55 2022] POST /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:48:55.712310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ca3a829c-ba6f-49f8-93fb-18365f7552dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '.version_select at 0x7fe5fd359dc0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:55.733254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ca3a829c-ba6f-49f8-93fb-18365f7552dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045044092" status: 202 len: 0 microversion: 2.1 time: 0.024977 Jun 16 16:48:55.734253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 458/823] 10.222.0.74 () {58 vars in 1220 bytes} [Thu Jun 16 16:48:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1045044092 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:48:55.743827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:55.745123 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:55.756253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.757055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.758431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:55.759229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:55.970739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:55.981191 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c4eef183-b069-4d66-b1db-b61878a7d564 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1721 microversion: 2.1 time: 0.245322 Jun 16 16:48:55.981978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 459/824] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:55 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:56.560334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-875def41-14b1-4927-ad3e-6196ed87e2fd tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: .version_select at 0x7fe5f89c55e0>, body: {"keypair": {"name": "tempest-keypair-763099429", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9O0ti035m2N2zbL79QGwxsVUfjoYpYM+RMSKuxfEv5e5+a7EduLOLx5JfdcYZRWx20DSAf886U6MInbPd1va697sigGbbZD1R+3+Hd/SdS5Iu89xpaPF5lWRD5oVNjoQ=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:56.575256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-875def41-14b1-4927-ad3e-6196ed87e2fd tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:48:56.579266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-875def41-14b1-4927-ad3e-6196ed87e2fd tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:48:56.603202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-875def41-14b1-4927-ad3e-6196ed87e2fd tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046607 Jun 16 16:48:56.604018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 460/825] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:48:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:48:57.018364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:57.019168 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:57.030547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:57.032276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:57.033677 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:57.034708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:57.284288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:57.295183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e79a78a4-dfe5-4466-afc2-cd315ba270d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1721 microversion: 2.1 time: 0.284634 Jun 16 16:48:57.296321 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 461/826] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:57 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:48:58.294716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-90839871", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e1f0da2-a24e-4041-9def-f84f18fbaf90"}], "security_groups": [{"name": "tempest-securitygroup--197356172"}], "key_name": "tempest-keypair-763099429", "user_data": "}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:48:58.403444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] validate_networks() for [('9e1f0da2-a24e-4041-9def-f84f18fbaf90', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:48:58.819658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:48:58.820181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:48:58.820691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:48:58.821334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:48:58.821901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:48:58.834816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:58.835475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:58.836892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:58.837646 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:58.858981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:48:58.863237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:48:58.879718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:48:58.882012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:48:58.938690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-153b3db5-8167-4f6a-9cf3-646f2edfb767 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.648155 Jun 16 16:48:58.939389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 462/827] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:48:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:48:58.948992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:58.949640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:58.962390 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:58.962945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:58.963982 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:48:58.964561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:48:59.124036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:59.133655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0865a70f-8c31-4fe1-8caf-99925796c80c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1721 microversion: 2.1 time: 0.189791 Jun 16 16:48:59.134261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 463/828] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:58 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:48:59.139004 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4f8e77cc-825c-4ed1-9951-300ededde600 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:48:59.139632 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4f8e77cc-825c-4ed1-9951-300ededde600 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:48:59.198743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4f8e77cc-825c-4ed1-9951-300ededde600 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:48:59.206032 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4f8e77cc-825c-4ed1-9951-300ededde600 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1239 microversion: 2.1 time: 0.070711 Jun 16 16:48:59.206664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 464/829] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:48:59 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:00.152567 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:00.153284 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:00.160362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:00.160811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:00.161560 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:00.162005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:00.305419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:00.314305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-87e13404-9b08-46af-bd46-5250ac511632 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1721 microversion: 2.1 time: 0.165631 Jun 16 16:49:00.314899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 465/830] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:00 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:00.319517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-409bc2db-9b4d-449c-8a0e-4ce370f1df64 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:00.320117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-409bc2db-9b4d-449c-8a0e-4ce370f1df64 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:00.374133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-409bc2db-9b4d-449c-8a0e-4ce370f1df64 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:00.381565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-409bc2db-9b4d-449c-8a0e-4ce370f1df64 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1239 microversion: 2.1 time: 0.065623 Jun 16 16:49:00.382142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 466/831] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:00 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:01.334683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:01.335679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:01.345286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:01.345739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:01.346521 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:01.346983 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:01.494823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:01.503503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1da95e42-86bc-4bd5-a822-9c0a04ba8658 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1727 microversion: 2.1 time: 0.172981 Jun 16 16:49:01.504082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 467/832] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:01 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:01.508795 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-56b9f791-6181-47c4-8a76-657939ee843b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:01.509399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-56b9f791-6181-47c4-8a76-657939ee843b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:01.567035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-56b9f791-6181-47c4-8a76-657939ee843b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:01.573817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-56b9f791-6181-47c4-8a76-657939ee843b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1239 microversion: 2.1 time: 0.068777 Jun 16 16:49:01.574423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 468/833] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:01 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:01.579462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e37c64fe-b016-4bb1-a897-149499da26d7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:01.579941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e37c64fe-b016-4bb1-a897-149499da26d7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:01.586190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37c64fe-b016-4bb1-a897-149499da26d7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:01.586551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37c64fe-b016-4bb1-a897-149499da26d7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:01.587341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37c64fe-b016-4bb1-a897-149499da26d7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:01.587762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37c64fe-b016-4bb1-a897-149499da26d7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:01.605492 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:01.670781 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e37c64fe-b016-4bb1-a897-149499da26d7 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095288 Jun 16 16:49:01.672013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 469/834] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:49:01 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:49:02.593394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:02.594043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:02.601527 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:02.601969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:02.602804 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:02.603331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:02.670425 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:02.678740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-df89a58d-000e-42fa-b19d-a37ec6cf058f tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1243 microversion: 2.1 time: 0.089913 Jun 16 16:49:02.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 470/835] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:02 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1243 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:03.696427 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:03.697312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:03.704604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:03.705046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:03.705840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:03.706544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:03.770545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:03.778380 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-64f45ec3-81a5-4749-b56c-7588fb6fce48 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1291 microversion: 2.1 time: 0.085989 Jun 16 16:49:03.778959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 471/836] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:03 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1291 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:49:04.795818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:04.796734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:04.803644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:04.804000 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:04.804760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:04.805192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:04.874064 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:04.883146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-30b28c72-10e5-44d2-883c-5f0e898fe447 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1297 microversion: 2.1 time: 0.091052 Jun 16 16:49:04.883889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 472/837] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:04 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:05.906402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:05.908442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:05.916187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:05.916625 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:05.917395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:05.917851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:06.057633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:06.065507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f60c9845-3e07-434f-8b00-4659acfc65fa tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.166441 Jun 16 16:49:06.066099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 473/838] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:05 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:49:07.083510 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:07.084371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:07.091169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:07.091609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:07.092364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:07.092783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:07.222989 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:07.230612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-40654b90-7af5-451a-b44b-f8121d1a5295 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.151143 Jun 16 16:49:07.231188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 474/839] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:07 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:49:08.248076 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:08.248753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:08.256193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:08.256638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:08.257400 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:08.257830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:08.396230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:08.404108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c520bfa9-1369-44ec-87de-ced3b127f30d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.160159 Jun 16 16:49:08.404681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 475/840] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:08 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:09.422333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:09.422950 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:09.424846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:09.426396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:09.432696 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:09.433128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:09.433877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:09.434315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:09.582245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:09.589787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0f9fc244-1c02-45cf-a9e2-c68984520242 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.172084 Jun 16 16:49:09.590366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 476/841] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:09 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:49:09.775585 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:49:09.776194 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:49:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:49:09.922117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-83f11a0f-e3cc-4d79-befe-28de27a14aa0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:09.922570 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-83f11a0f-e3cc-4d79-befe-28de27a14aa0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:09.929163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83f11a0f-e3cc-4d79-befe-28de27a14aa0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:09.929595 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83f11a0f-e3cc-4d79-befe-28de27a14aa0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:09.930373 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83f11a0f-e3cc-4d79-befe-28de27a14aa0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:09.930798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83f11a0f-e3cc-4d79-befe-28de27a14aa0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:09.962400 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-83f11a0f-e3cc-4d79-befe-28de27a14aa0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments/a8c52455-b61e-4153-95bc-1506e09595bb" status: 200 len: 194 microversion: 2.20 time: 0.044521 Jun 16 16:49:09.963002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 477/842] 10.222.0.74 () {60 vars in 1453 bytes} [Thu Jun 16 16:49:09 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments/a8c52455-b61e-4153-95bc-1506e09595bb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:49:10.027351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:10.027886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:10.035069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:10.035507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:10.036261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:10.036681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:10.273810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lazy-loading 'services' on Instance uuid 0b7f89d4-2837-48f0-854e-4267acb270bb {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:49:10.355904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-06a74bf4-e814-4da8-b1d6-0414f3d3c8dd tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments/a8c52455-b61e-4153-95bc-1506e09595bb" status: 202 len: 0 microversion: 2.20 time: 0.332436 Jun 16 16:49:10.356502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 478/843] 10.222.0.74 () {60 vars in 1456 bytes} [Thu Jun 16 16:49:10 2022] DELETE /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments/a8c52455-b61e-4153-95bc-1506e09595bb => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:49:10.365612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d3e4a062-beda-4aeb-aa4a-b61effd4949e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:10.366692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d3e4a062-beda-4aeb-aa4a-b61effd4949e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:10.373329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3e4a062-beda-4aeb-aa4a-b61effd4949e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:10.373812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3e4a062-beda-4aeb-aa4a-b61effd4949e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:10.374638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3e4a062-beda-4aeb-aa4a-b61effd4949e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:10.375167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d3e4a062-beda-4aeb-aa4a-b61effd4949e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:10.405876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d3e4a062-beda-4aeb-aa4a-b61effd4949e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044393 Jun 16 16:49:10.406468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 479/844] 10.222.0.74 () {60 vars in 1342 bytes} [Thu Jun 16 16:49:10 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:49:10.606830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:10.607515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:10.614468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:10.614909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:10.615684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:10.616128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:10.754398 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:10.762577 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-65bfc4aa-a899-4c94-af12-729a5189a172 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.159622 Jun 16 16:49:10.763220 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 480/845] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:10 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:11.419924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5e1779fa-79c1-4d0e-aed2-7499fa24b769 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:11.421650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5e1779fa-79c1-4d0e-aed2-7499fa24b769 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:11.429279 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5e1779fa-79c1-4d0e-aed2-7499fa24b769 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:11.429786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5e1779fa-79c1-4d0e-aed2-7499fa24b769 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:11.430563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5e1779fa-79c1-4d0e-aed2-7499fa24b769 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:11.430972 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5e1779fa-79c1-4d0e-aed2-7499fa24b769 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:11.461847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5e1779fa-79c1-4d0e-aed2-7499fa24b769 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046721 Jun 16 16:49:11.462744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 481/846] 10.222.0.74 () {60 vars in 1342 bytes} [Thu Jun 16 16:49:11 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:49:11.537605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-b1370e96-7311-4f2c-875f-28b0f397eeb4 req-31445789-43db-45eb-9fbb-6d22463501b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a73efd2c-4bd0-4f43-a720-aa81521289a8", "name": "network-vif-plugged", "status": "completed", "tag": "9802eee4-6c99-4fe8-9ec9-181124626a8a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:49:11.546129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-b1370e96-7311-4f2c-875f-28b0f397eeb4 req-31445789-43db-45eb-9fbb-6d22463501b6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:11.546640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-b1370e96-7311-4f2c-875f-28b0f397eeb4 req-31445789-43db-45eb-9fbb-6d22463501b6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:11.558898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-b1370e96-7311-4f2c-875f-28b0f397eeb4 req-31445789-43db-45eb-9fbb-6d22463501b6 service nova] Creating event network-vif-plugged:9802eee4-6c99-4fe8-9ec9-181124626a8a for instance a73efd2c-4bd0-4f43-a720-aa81521289a8 on hv-cinder-83735 Jun 16 16:49:11.564333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-b1370e96-7311-4f2c-875f-28b0f397eeb4 req-31445789-43db-45eb-9fbb-6d22463501b6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030355 Jun 16 16:49:11.565199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 482/847] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:49:11.781040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:11.781742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:11.783801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=16 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:11.790487 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:11.790940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:11.791734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:11.792166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:11.924757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:11.932816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2c0d9712-21dc-449b-b3c7-4b1b804f3ca3 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.155981 Jun 16 16:49:11.933365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 483/848] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:11 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:12.474287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-61d8780b-4e62-4f64-b78e-7bc4e0241a8f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:12.475248 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-61d8780b-4e62-4f64-b78e-7bc4e0241a8f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:12.482054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61d8780b-4e62-4f64-b78e-7bc4e0241a8f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.482500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61d8780b-4e62-4f64-b78e-7bc4e0241a8f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:12.483322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61d8780b-4e62-4f64-b78e-7bc4e0241a8f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.483755 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61d8780b-4e62-4f64-b78e-7bc4e0241a8f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:12.515624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-61d8780b-4e62-4f64-b78e-7bc4e0241a8f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045368 Jun 16 16:49:12.516184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 484/849] 10.222.0.74 () {60 vars in 1342 bytes} [Thu Jun 16 16:49:12 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:49:12.576227 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:12.576734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:12.583266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.583706 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:12.584461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.584884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:12.612307 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:49:12.640476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:12.697786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6ff6b4fc-d1f0-473e-9084-85a80c3fb8f4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 204 len: 0 microversion: 2.20 time: 0.125198 Jun 16 16:49:12.698429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 485/850] 10.222.0.74 () {60 vars in 1279 bytes} [Thu Jun 16 16:49:12 2022] DELETE /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 16:49:12.708341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:12.709106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:12.715697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.716160 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:12.716922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.717353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:12.855254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:12.864021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:12.865533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:12.866724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-494b4c88-1fdb-4c1e-9435-a734093d7ff1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.162823 Jun 16 16:49:12.867308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 486/851] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:12 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:12.950245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:12.950847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:12.958124 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.958568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:12.959377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:12.959807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:13.098921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:13.106895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-78d6420f-38e9-44de-b8c1-2287c2f37e06 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.160628 Jun 16 16:49:13.107429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 487/852] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:12 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:13.886355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:13.887124 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:13.894504 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:13.894946 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:13.895753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:13.896512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:14.031719 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:14.043605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:14.045719 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:14.047469 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7b3c393d-c1bf-4cbc-b149-60151acccd27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.165112 Jun 16 16:49:14.048036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 488/853] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:13 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:14.126967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:14.127983 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:14.136688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:14.137137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:14.138035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:14.138547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:14.279411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:14.290862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc813f46-8f5c-4831-87fd-9527b8c6458c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1364 microversion: 2.1 time: 0.170217 Jun 16 16:49:14.291492 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 489/854] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:14 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:49:15.069858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:15.070926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:15.080433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:15.080873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:15.081631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:15.082054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:15.216237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:15.225106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:15.226587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:15.227782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-879e6df8-7f8a-4ce2-bf15-304b795974f0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.164503 Jun 16 16:49:15.228353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 490/855] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:15 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:15.315686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:15.320695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:15.327173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:15.327665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:15.329057 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:15.329490 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:15.471731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:15.480799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-feb62c8f-e7ca-4a52-b88e-1f27e8bee3a9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1553 microversion: 2.1 time: 0.171386 Jun 16 16:49:15.481491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 491/856] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:49:15 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:49:15.497868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-125a6576-fd53-41c5-8d10-3d2e73df11f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:15.498347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-125a6576-fd53-41c5-8d10-3d2e73df11f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:15.504807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-125a6576-fd53-41c5-8d10-3d2e73df11f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:15.505243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-125a6576-fd53-41c5-8d10-3d2e73df11f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:15.506026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-125a6576-fd53-41c5-8d10-3d2e73df11f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:15.506424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-125a6576-fd53-41c5-8d10-3d2e73df11f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:15.586376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-125a6576-fd53-41c5-8d10-3d2e73df11f2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092134 Jun 16 16:49:15.587565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 492/857] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:49:15 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:49:16.246626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:16.247373 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:16.254593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:16.255038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:16.255822 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:16.256252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:16.388543 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:16.397405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:16.398892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:16.400099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-14d25106-a15b-4894-94fc-79829dd6cc4a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1723 microversion: 2.20 time: 0.157997 Jun 16 16:49:16.400641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 493/858] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:16 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:17.418395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:17.420041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:17.428140 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:17.428866 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:17.429877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:17.430514 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:17.537349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:17.558818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:17.563721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:17.565195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5d94ab69-2dd6-4326-9b1f-c827786a26aa tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 200 len: 1656 microversion: 2.20 time: 0.150823 Jun 16 16:49:17.576542 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 494/859] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:17 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 1656 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:49:18.584277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:18.584952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:18.591407 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:18.592068 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:18.593001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:18.593664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:18.607585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] HTTP exception thrown: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Request method failure captured: Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb HTTP/1.1 Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MPfRph0ckii1mOZNGy2sSQ_w87mnVX-vhGnFbwbZrMqVzjhzDJlo2YqIozCUf_KfI2MSFMYm_vhrEnduqBLExGo_DlLZGDmHwHG221IOXPco7uxl12gRPbWjYiAjpxBOQpqmzUeXTIvfzF8WKM6d_Q3xGX5nP0bQwaG9RZoRPAYg Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 627133a3363742fda58273b067fab968 Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:49:18.609391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/627133a3363742fda58273b067fab968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_627133a3363742fda58273b067fab968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 627133a3363742fda58273b067fab968 Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 80113e82c4a74f4e8fd42b88aca3920d Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:49:18.611286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0b7f89d4-2837-48f0-854e-4267acb270bb'} Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:49:18.614078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:49:18.615471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:49:18.616815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Returning 404 to user: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:49:18.616815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cecaa5fa-5afa-4c66-aada-daa5f20c8b0b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 404 len: 111 microversion: 2.20 time: 0.030520 Jun 16 16:49:18.616815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 495/860] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:18 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:49:18.620651 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-23297d65-583e-4736-a4b8-d62a44b7b2dc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '.version_select at 0x7fe5f8b0e790>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:18.643799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-23297d65-583e-4736-a4b8-d62a44b7b2dc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987447955" status: 204 len: 0 microversion: 2.20 time: 0.027148 Jun 16 16:49:18.644679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 496/861] 10.222.0.74 () {60 vars in 1258 bytes} [Thu Jun 16 16:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987447955 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 16:49:19.303828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2320f1ad-a442-4f97-967a-08232d192a84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'create', calling method: .version_select at 0x7fe5f89c53a0>, body: {"keypair": {"name": "tempest-keypair-429904795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDg9VYBoEMlp9wtZj63WF+0ad0ubQjt7FPjO+yCsoc1hwuKqWeTQr3yDzknN3gRblArIOEUzSGRoV7wp5hYaH6TnkGSaFmUUr61iubf4JzJpAeeqp50Wawh5Wymb7Fpqrw=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:49:19.319025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-2320f1ad-a442-4f97-967a-08232d192a84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for project 627133a3363742fda58273b067fab968. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:49:19.322992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-2320f1ad-a442-4f97-967a-08232d192a84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for user 80113e82c4a74f4e8fd42b88aca3920d and project 627133a3363742fda58273b067fab968. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:49:19.345818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2320f1ad-a442-4f97-967a-08232d192a84 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046265 Jun 16 16:49:19.346433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 497/862] 10.222.0.74 () {62 vars in 1199 bytes} [Thu Jun 16 16:49:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 16 16:49:20.688223 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1691535088", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9928c0d7-4188-44f9-85a5-0c6e9b826316"}], "security_groups": [{"name": "tempest-securitygroup--1587686701"}], "key_name": "tempest-keypair-429904795", "user_data": "}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:49:20.795590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] validate_networks() for [('9928c0d7-4188-44f9-85a5-0c6e9b826316', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:49:21.200190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:49:21.200614 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:49:21.201086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:49:21.201491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:49:21.201900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:49:21.211436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:21.211883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:21.212680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:21.213115 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:21.231823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for project 627133a3363742fda58273b067fab968. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:49:21.236364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Getting quotas for user 80113e82c4a74f4e8fd42b88aca3920d and project 627133a3363742fda58273b067fab968. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:49:21.248607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:49:21.250923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:49:21.301010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-06a65e56-5461-4002-977f-d229b7ed627e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.617568 Jun 16 16:49:21.301762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 498/863] 10.222.0.74 () {62 vars in 1187 bytes} [Thu Jun 16 16:49:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 16 16:49:21.315064 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-392a15de-dd70-4a59-b22b-0d0ade95883e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:21.315781 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-392a15de-dd70-4a59-b22b-0d0ade95883e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:21.373353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-392a15de-dd70-4a59-b22b-0d0ade95883e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:21.381487 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-392a15de-dd70-4a59-b22b-0d0ade95883e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:21.382963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-392a15de-dd70-4a59-b22b-0d0ade95883e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:21.384068 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-392a15de-dd70-4a59-b22b-0d0ade95883e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1281 microversion: 2.20 time: 0.073118 Jun 16 16:49:21.384618 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 499/864] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:21 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1281 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:22.402709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:22.403420 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:22.422598 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:22.423032 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:22.423845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:22.424275 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:22.495420 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:22.506662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:22.508706 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:22.510341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-51c05946-8ad3-4f8f-a503-1a34fb22266a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1341 microversion: 2.20 time: 0.111726 Jun 16 16:49:22.510902 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 500/865] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:22 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1341 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:23.529193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:23.529865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:23.537246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:23.537702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:23.538486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:23.538923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:23.689364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:23.697845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:23.699363 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:23.700478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-350c0206-5955-446e-a69f-f60a1c4073d1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.175499 Jun 16 16:49:23.701072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 501/866] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:23 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:49:24.719850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:24.720563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:24.727904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:24.728344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:24.729098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:24.729526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:24.887332 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:24.900346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:24.902662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:24.904459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-76bda839-13ce-460d-9af0-d64319b4e1fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.188311 Jun 16 16:49:24.905206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 502/867] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:24 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:25.927369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:25.928401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:25.939006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:25.939482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:25.940245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:25.940671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:26.103755 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:26.112382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:26.113854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:26.114943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-45de0425-e20d-47c8-a255-a6bc57e9a7d9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.194711 Jun 16 16:49:26.115531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 503/868] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:25 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:27.136687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:27.137765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:27.149529 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:27.150352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:27.151670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:27.152387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:27.286789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:27.300006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:27.302192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:27.303931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-722c43d7-178c-4602-8353-26a3dfdcf4e8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.173604 Jun 16 16:49:27.304793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 504/869] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:27 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:28.325941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:28.326621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:28.333683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:28.334116 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:28.334878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:28.335337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:28.468290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:28.481877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:28.484328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:28.485430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4da48ecd-a483-4076-bb91-946a49a5479f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.163547 Jun 16 16:49:28.486010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 505/870] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:28 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:29.504818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:29.505475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:29.512361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:29.512800 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:29.513550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:29.513971 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:29.519069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:29.647932 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:29.656065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:29.657834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:29.658962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d2cb4926-773b-44d9-a0f3-197ec5040efc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.158171 Jun 16 16:49:29.659888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 506/871] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:29 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:30.678233 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:30.678910 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:30.686689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:30.687255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:30.688221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:30.688705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:30.824586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:30.833035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:30.834521 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:30.835656 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-983ae5d8-8953-4c0d-9708-22ed81e7cb3a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.161872 Jun 16 16:49:30.836262 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 507/872] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:30 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:31.853286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:31.854135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:31.855851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:31.856631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=12 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:31.857942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:49:31.865229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:31.865689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:31.866723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:31.867300 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:32.012660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:32.024393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:32.025875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:32.026975 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-28894391-706f-4db1-853e-42140a39d016 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.177642 Jun 16 16:49:32.027581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 508/873] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:31 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:49:32.032041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-5ff2d76b-db7f-4f4c-a59d-6aac9c3a90a7 req-d97da45d-aee4-4a3c-a054-88b3b27da721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc30a47-0cf1-4fae-b736-0f67761e2150", "name": "network-vif-plugged", "status": "completed", "tag": "3438f639-56b8-451a-81c9-c4ec1500cf56"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:49:32.040136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5ff2d76b-db7f-4f4c-a59d-6aac9c3a90a7 req-d97da45d-aee4-4a3c-a054-88b3b27da721 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:32.040564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5ff2d76b-db7f-4f4c-a59d-6aac9c3a90a7 req-d97da45d-aee4-4a3c-a054-88b3b27da721 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:32.052306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-5ff2d76b-db7f-4f4c-a59d-6aac9c3a90a7 req-d97da45d-aee4-4a3c-a054-88b3b27da721 service nova] Creating event network-vif-plugged:3438f639-56b8-451a-81c9-c4ec1500cf56 for instance bbc30a47-0cf1-4fae-b736-0f67761e2150 on hv-cinder-83735 Jun 16 16:49:32.057305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-5ff2d76b-db7f-4f4c-a59d-6aac9c3a90a7 req-d97da45d-aee4-4a3c-a054-88b3b27da721 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028650 Jun 16 16:49:32.058080 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 509/874] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:49:33.050276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:33.051125 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:33.059482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:33.060020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:33.060920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:33.061436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:33.199395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:33.208853 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:33.210353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:33.211503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5333b80a-e530-453d-a1bb-af120bdd122a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1407 microversion: 2.20 time: 0.168346 Jun 16 16:49:33.212068 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 510/875] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:33 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:49:34.233436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:34.234192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:34.243198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:34.243641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:34.244414 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:34.244842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:34.391185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:34.399929 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:34.401428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:49:34.402608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a653b25c-4476-42d7-bf20-014c79d91172 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1598 microversion: 2.20 time: 0.174960 Jun 16 16:49:34.403200 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 511/876] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:49:34 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1598 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:49:34.419741 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6534a2ea-09b3-43b1-8ef0-d7cc29b6951c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:49:34.420224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6534a2ea-09b3-43b1-8ef0-d7cc29b6951c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:49:34.426393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6534a2ea-09b3-43b1-8ef0-d7cc29b6951c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:34.426843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6534a2ea-09b3-43b1-8ef0-d7cc29b6951c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:34.427640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6534a2ea-09b3-43b1-8ef0-d7cc29b6951c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:34.428070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6534a2ea-09b3-43b1-8ef0-d7cc29b6951c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:34.514455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6534a2ea-09b3-43b1-8ef0-d7cc29b6951c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098241 Jun 16 16:49:34.515105 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 512/877] 10.222.0.74 () {60 vars in 1315 bytes} [Thu Jun 16 16:49:34 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:49:35.678891 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-1fbcfd14-4cf5-4375-9d6f-8ce4639561de req-ba57b1de-fddf-43e6-a8a0-6e04ffae8a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbc30a47-0cf1-4fae-b736-0f67761e2150", "tag": "3438f639-56b8-451a-81c9-c4ec1500cf56"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:49:35.687608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1fbcfd14-4cf5-4375-9d6f-8ce4639561de req-ba57b1de-fddf-43e6-a8a0-6e04ffae8a6f service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:49:35.688323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1fbcfd14-4cf5-4375-9d6f-8ce4639561de req-ba57b1de-fddf-43e6-a8a0-6e04ffae8a6f service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:49:35.700026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-1fbcfd14-4cf5-4375-9d6f-8ce4639561de req-ba57b1de-fddf-43e6-a8a0-6e04ffae8a6f service nova] Creating event network-changed:3438f639-56b8-451a-81c9-c4ec1500cf56 for instance bbc30a47-0cf1-4fae-b736-0f67761e2150 on hv-cinder-83735 Jun 16 16:49:35.705236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-1fbcfd14-4cf5-4375-9d6f-8ce4639561de req-ba57b1de-fddf-43e6-a8a0-6e04ffae8a6f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030637 Jun 16 16:49:35.705980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 513/878] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:49:47.843190 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:49:47.843936 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:49:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:50:19.743805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=11 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:19.744578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=36 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:19.750323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:19.751117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:19.760018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:19.760459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:19.761214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:19.761638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:19.846610 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lazy-loading 'services' on Instance uuid 76def3bd-d733-4708-adad-1e7e7d17a584 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:50:19.929251 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c45f28b1-ebe0-4aec-9528-a8cfa7d88bcb tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "DELETE /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments/f5fa6580-7a54-4c09-8ff7-7fe10f2c4c29" status: 202 len: 0 microversion: 2.1 time: 0.188065 Jun 16 16:50:19.929846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 514/879] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:50:19 2022] DELETE /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments/f5fa6580-7a54-4c09-8ff7-7fe10f2c4c29 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:50:19.938554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3a08663d-4e4c-4ed3-bcb9-ba89a3f59127 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:19.939812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3a08663d-4e4c-4ed3-bcb9-ba89a3f59127 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:19.947038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a08663d-4e4c-4ed3-bcb9-ba89a3f59127 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:19.947547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a08663d-4e4c-4ed3-bcb9-ba89a3f59127 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:19.948269 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a08663d-4e4c-4ed3-bcb9-ba89a3f59127 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:19.948686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a08663d-4e4c-4ed3-bcb9-ba89a3f59127 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:19.981410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3a08663d-4e4c-4ed3-bcb9-ba89a3f59127 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Jun 16 16:50:19.981973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 515/880] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:50:19 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:50:20.995092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a07aac5c-67f4-4f7e-a5e7-026dcf9bb86c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:20.996031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a07aac5c-67f4-4f7e-a5e7-026dcf9bb86c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:21.003094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07aac5c-67f4-4f7e-a5e7-026dcf9bb86c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:21.003546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07aac5c-67f4-4f7e-a5e7-026dcf9bb86c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:21.004305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07aac5c-67f4-4f7e-a5e7-026dcf9bb86c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:21.004730 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07aac5c-67f4-4f7e-a5e7-026dcf9bb86c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:21.036831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a07aac5c-67f4-4f7e-a5e7-026dcf9bb86c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045732 Jun 16 16:50:21.037385 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 516/881] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:50:20 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:50:22.052121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9429c9ac-56f6-4c37-8088-8c4a7d89834c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:22.053592 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9429c9ac-56f6-4c37-8088-8c4a7d89834c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:22.064650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9429c9ac-56f6-4c37-8088-8c4a7d89834c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:22.065379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9429c9ac-56f6-4c37-8088-8c4a7d89834c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:22.066641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9429c9ac-56f6-4c37-8088-8c4a7d89834c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:22.067564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9429c9ac-56f6-4c37-8088-8c4a7d89834c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:22.097397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9429c9ac-56f6-4c37-8088-8c4a7d89834c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052125 Jun 16 16:50:22.097962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 517/882] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:50:22 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:50:22.173892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:22.174405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:22.180563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:22.180994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:22.181738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:22.182158 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:22.206857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:50:22.291145 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-61152c4e-7c2b-4ecc-a49f-04a07bfbf677 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "DELETE /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 204 len: 0 microversion: 2.1 time: 0.120676 Jun 16 16:50:22.291742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 518/883] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:50:22 2022] DELETE /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:50:22.300952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:22.301683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:22.309161 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:22.309618 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:22.310450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:22.310943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:22.447446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:22.455601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8f869197-3180-4d8f-bdfa-901a41a32604 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1687 microversion: 2.1 time: 0.158906 Jun 16 16:50:22.456170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 519/884] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:22 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:23.476368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:23.476973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:23.484389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:23.484814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:23.485611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:23.486194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:23.627287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:23.635472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a9b82c6f-2f1b-49ce-b845-7e64f0f83278 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1687 microversion: 2.1 time: 0.164878 Jun 16 16:50:23.636346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 520/885] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:23 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1687 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:24.656875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:24.657914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:24.669114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:24.669844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:24.671138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:24.671829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:24.809940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:24.818400 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ba2cf165-5ea5-484c-88b0-2b285f1f8fcc tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1687 microversion: 2.1 time: 0.167988 Jun 16 16:50:24.818969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 521/886] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:24 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:25.836581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:25.837216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:25.844342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:25.844792 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:25.845566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:25.846002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:25.909967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:25.918254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3b004612-f5b2-47d4-b46d-e3dfd71c65ce tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 200 len: 1620 microversion: 2.1 time: 0.086170 Jun 16 16:50:25.918838 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 522/887] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:25 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 1620 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:26.936225 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:26.936926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 76def3bd-d733-4708-adad-1e7e7d17a584] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:26.943887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:26.944328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:26.945083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:26.945505 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:26.961396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] HTTP exception thrown: Instance 76def3bd-d733-4708-adad-1e7e7d17a584 could not be found. Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Request method failure captured: Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 HTTP/1.1 Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq11ro5b6A7FX6ganUFkpAtzCii9mMuj67uU_EJNeKXyOVPEi11CdokpdBemuXsxHJ3EWXeF6Gk6i83UtOmjUgKcNggIs7XNblR-5bgNopCBBFauzxp28j6cQ1iAIDY97oyTWK_pk6Wim5GNajqAEYXr3_6QO1M8H2BAoUD6g3UGqsMo Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:50:26.963118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 86f1f2722c5c4da59fd83036ce1700e1 Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 76def3bd-d733-4708-adad-1e7e7d17a584 could not be found. Jun 16 16:50:26.964575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '76def3bd-d733-4708-adad-1e7e7d17a584'} Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76def3bd-d733-4708-adad-1e7e7d17a584 could not be found. Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:50:26.965422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76def3bd-d733-4708-adad-1e7e7d17a584 could not be found. Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76def3bd-d733-4708-adad-1e7e7d17a584 could not be found. Jun 16 16:50:26.966775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:26.967949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Returning 404 to user: Instance 76def3bd-d733-4708-adad-1e7e7d17a584 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:50:26.967949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ddfa36b5-49f4-4a66-bd3c-34e00601fe4c tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584" status: 404 len: 111 microversion: 2.1 time: 0.032285 Jun 16 16:50:26.967949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 523/888] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:26 2022] GET /compute/v2.1/servers/76def3bd-d733-4708-adad-1e7e7d17a584 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:50:26.973008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ab188676-ef06-4630-b697-9e06542d7b2b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '.version_select at 0x7fe5f8afc310>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:26.993360 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ab188676-ef06-4630-b697-9e06542d7b2b tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-304364425" status: 202 len: 0 microversion: 2.1 time: 0.023797 Jun 16 16:50:26.994004 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 524/889] 10.222.0.74 () {58 vars in 1217 bytes} [Thu Jun 16 16:50:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-304364425 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:50:29.232144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:29.232777 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:29.240194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:29.240638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:29.241391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:29.241837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:29.266686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:50:29.350954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-96eb4e78-40f9-459b-9a75-e3f55a49d8fa tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "DELETE /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 204 len: 0 microversion: 2.1 time: 0.123189 Jun 16 16:50:29.354728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 525/890] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:50:29 2022] DELETE /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:50:29.357386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-f3cb19bf-ded8-4e2b-b21f-a5961187bba4 req-ab6c7660-b527-4744-8d35-675095cb7385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102aa75e-21d3-415e-9a04-d44e46ca9308", "tag": "67748224-b4d4-4324-99dd-41ee8f120ef2"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:50:29.366018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-f3cb19bf-ded8-4e2b-b21f-a5961187bba4 req-ab6c7660-b527-4744-8d35-675095cb7385 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:29.366454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-f3cb19bf-ded8-4e2b-b21f-a5961187bba4 req-ab6c7660-b527-4744-8d35-675095cb7385 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:29.377495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-f3cb19bf-ded8-4e2b-b21f-a5961187bba4 req-ab6c7660-b527-4744-8d35-675095cb7385 service nova] Creating event network-changed:67748224-b4d4-4324-99dd-41ee8f120ef2 for instance 102aa75e-21d3-415e-9a04-d44e46ca9308 on hv-cinder-83735 Jun 16 16:50:29.382411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-f3cb19bf-ded8-4e2b-b21f-a5961187bba4 req-ab6c7660-b527-4744-8d35-675095cb7385 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029162 Jun 16 16:50:29.383003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 526/891] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:50:29.389082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:29.389780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:29.396894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:29.397392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:29.398477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:29.398908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:29.540537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:29.549062 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-96059fe0-7066-4e5d-b96c-c4babaec92c9 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.164138 Jun 16 16:50:29.550427 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 527/892] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:29 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:29.890763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:29.891348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:29.898219 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:29.898725 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:29.899513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:29.899930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:29.924988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:50:29.928068 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:30.010594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-abdf2017-4e05-4348-a081-05cb81130444 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "DELETE /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 204 len: 0 microversion: 2.1 time: 0.123690 Jun 16 16:50:30.011359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 528/893] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:50:29 2022] DELETE /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:50:30.019787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:30.020528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:30.027433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:30.027882 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:30.028650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:30.029077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:30.165966 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:30.174189 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a75f0d88-ba35-47db-bcb4-41b88def6a01 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1507 microversion: 2.1 time: 0.158621 Jun 16 16:50:30.174935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 529/894] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:30 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:30.566496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:30.567728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:30.574812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:30.575297 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:30.576088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:30.576514 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:30.716050 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:30.727329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cf37718b-88e4-42e8-bf4e-c1fe98c21f64 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.164749 Jun 16 16:50:30.727923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 530/895] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:30 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:31.193550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:31.194195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:31.201951 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.202503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.203471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.204005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.342134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:31.350198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-92a1ecaa-c15e-42e2-8b9f-a2a673323aa5 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1507 microversion: 2.1 time: 0.161805 Jun 16 16:50:31.350750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 531/896] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:31 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:31.355634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:31.356109 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:31.362735 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.363210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.364049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.364571 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.389907 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:50:31.471855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6209885a-0aa9-43d5-ac5a-1f5be64e25a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 204 len: 0 microversion: 2.1 time: 0.119774 Jun 16 16:50:31.472457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 532/897] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:50:31 2022] DELETE /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:50:31.481588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:31.482285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:31.488248 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.489316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.490083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.490517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.670595 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:31.678760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3c239542-5805-4c34-b15a-a385bad25e49 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1578 microversion: 2.1 time: 0.201170 Jun 16 16:50:31.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 533/898] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:31 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1578 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:31.745602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:31.746087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:31.752833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.753274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.754365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:31.754747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:31.890970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:31.901482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f653f23f-f1a9-4250-9a96-b8819c4bd025 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.159911 Jun 16 16:50:31.902065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 534/899] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:31 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:32.371607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:32.372608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:32.381773 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:32.382221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:32.382987 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:32.383455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:32.594738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:32.603726 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9a592ce9-5ab3-4608-893a-46bd16ac75f4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1507 microversion: 2.1 time: 0.238863 Jun 16 16:50:32.604305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 535/900] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:32 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:32.696411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:32.697099 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:32.703477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:32.703920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:32.704684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:32.705101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:32.947153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:32.955487 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-abc04075-748a-4549-9513-b239ac9c423d tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1578 microversion: 2.1 time: 0.262856 Jun 16 16:50:32.956326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 536/901] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:32 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1578 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:32.961255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:32.961851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:32.971905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:32.972565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:32.973516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:32.974093 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:33.172246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:33.181694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e81173a7-a9b7-49b5-8a9e-ba6991b443b0 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1569 microversion: 2.1 time: 0.223929 Jun 16 16:50:33.182434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 537/902] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:32 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:33.306880 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-c3e708b7-967e-4931-9180-3b7f9cd7750f req-44c17818-6db8-46c9-8b72-db70c3462cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6f57ed7-219e-4057-b423-462f36c3396c", "name": "network-vif-deleted", "tag": "0da84472-5bcf-4cb0-a569-2a78afef6667"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:50:33.316082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-c3e708b7-967e-4931-9180-3b7f9cd7750f req-44c17818-6db8-46c9-8b72-db70c3462cd6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:33.317221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-c3e708b7-967e-4931-9180-3b7f9cd7750f req-44c17818-6db8-46c9-8b72-db70c3462cd6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:33.328997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-c3e708b7-967e-4931-9180-3b7f9cd7750f req-44c17818-6db8-46c9-8b72-db70c3462cd6 service nova] Creating event network-vif-deleted:0da84472-5bcf-4cb0-a569-2a78afef6667 for instance d6f57ed7-219e-4057-b423-462f36c3396c on hv-cinder-83735 Jun 16 16:50:33.334780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-c3e708b7-967e-4931-9180-3b7f9cd7750f req-44c17818-6db8-46c9-8b72-db70c3462cd6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Jun 16 16:50:33.335427 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 538/903] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:50:33.627583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:33.628460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:33.643147 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:33.643751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:33.645126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:33.646944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:33.690042 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:33.690483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:33.690924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lazy-loading 'fault' on Instance uuid d6f57ed7-219e-4057-b423-462f36c3396c {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:50:33.740679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:33.749879 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f6a07211-35a8-4a5e-a9de-f3669672b5d2 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 200 len: 1312 microversion: 2.1 time: 0.127713 Jun 16 16:50:33.750465 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 539/904] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:33 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:33.979667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:33.981549 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:33.991249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:33.991683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:33.992461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:33.992893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.138256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:34.146133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fc94f4e0-77c1-4711-8f67-7c026468514f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1578 microversion: 2.1 time: 0.176385 Jun 16 16:50:34.146844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 540/905] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:33 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1578 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:34.200038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:34.200699 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:34.206796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.207337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.208096 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.208521 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.241178 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.241724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.242055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lazy-loading 'fault' on Instance uuid 102aa75e-21d3-415e-9a04-d44e46ca9308 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:50:34.282814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a47eeee1d19f4deb9402314872f7ba30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c099988d7bdc415ab2f206cbe567e77b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:34.290799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e4b041a4-99ea-46f0-8e5d-56e17c702fc1 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 200 len: 1225 microversion: 2.1 time: 0.094687 Jun 16 16:50:34.291764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 541/906] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:34 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:34.768551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:34.769178 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: d6f57ed7-219e-4057-b423-462f36c3396c] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:34.776522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.776982 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.777851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.778443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.783024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:34.794672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] HTTP exception thrown: Instance d6f57ed7-219e-4057-b423-462f36c3396c could not be found. Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Request method failure captured: Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c HTTP/1.1 Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq11ro5b6A7FX6ganUFkpAtzCii9mMuj67uU_EJNeKXyOVPEi11CdokpdBemuXsxHJ3EWXeF6Gk6i83UtOmjUgKcNggIs7XNblR-5bgNopCBBFauzxp28j6cQ1iAIDY97oyTWK_pk6Wim5GNajqAEYXr3_6QO1M8H2BAoUD6g3UGqsMo Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:50:34.796434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 86f1f2722c5c4da59fd83036ce1700e1 Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance d6f57ed7-219e-4057-b423-462f36c3396c could not be found. Jun 16 16:50:34.798052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'd6f57ed7-219e-4057-b423-462f36c3396c'} Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6f57ed7-219e-4057-b423-462f36c3396c could not be found. Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:50:34.798944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6f57ed7-219e-4057-b423-462f36c3396c could not be found. Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6f57ed7-219e-4057-b423-462f36c3396c could not be found. Jun 16 16:50:34.800435 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:34.802389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Returning 404 to user: Instance d6f57ed7-219e-4057-b423-462f36c3396c could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:50:34.802389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6fedd111-911d-4a97-8cbf-e9cf8e2d9998 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c" status: 404 len: 111 microversion: 2.1 time: 0.033798 Jun 16 16:50:34.802389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 542/907] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:34 2022] GET /compute/v2.1/servers/d6f57ed7-219e-4057-b423-462f36c3396c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:50:34.809886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:34.810374 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:34.817247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.817682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.818460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.818888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.847617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:50:34.933500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-446fd594-ca91-4b0d-b388-069a4045c4d4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "DELETE /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 204 len: 0 microversion: 2.1 time: 0.127276 Jun 16 16:50:34.934135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 543/908] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:50:34 2022] DELETE /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:50:34.946518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:34.947242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:34.954365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.955079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:34.956256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:34.956701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:35.100333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:35.108149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2e9fa5de-8d63-40a9-adc4-d654c7b71ec4 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.166686 Jun 16 16:50:35.108887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 544/909] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:34 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:35.164234 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:35.165046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:35.168833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=5,nova_api:DELETE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:35.173454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:35.173886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:35.174707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:35.175116 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:35.209627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:35.210070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:35.210526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lazy-loading 'fault' on Instance uuid 8e74018d-237a-4638-972d-b5b85e487dc5 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:50:35.252315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:35.260956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6a749c33-3ac0-4089-bd2d-d6f5dd5b6a41 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 200 len: 1230 microversion: 2.1 time: 0.101159 Jun 16 16:50:35.261584 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 545/910] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:35 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:35.308147 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:35.309059 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] [instance: 102aa75e-21d3-415e-9a04-d44e46ca9308] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:35.315705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:35.316181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:35.317150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:35.317618 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:35.332561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] HTTP exception thrown: Instance 102aa75e-21d3-415e-9a04-d44e46ca9308 could not be found. Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Request method failure captured: Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 HTTP/1.1 Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq117XvSZgNIu6UTio2snfHsy8M5migZqt34DwI6kngW5HbIjDsccsGfw8_8AnuD6ir5EIrVOpl3Lc9tMnmQ4BHySj-S0UmdRSMxZey3Q3xLzJw-tXm0uzHTe2x6kshaT4bLkIZ_cZ4f1ASfhIyXSNHkaknURX9D_1B-_WUgndWQVkDg Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: c099988d7bdc415ab2f206cbe567e77b Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestShelveInstance-1729554378 Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:50:35.334258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c099988d7bdc415ab2f206cbe567e77b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/c099988d7bdc415ab2f206cbe567e77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/c099988d7bdc415ab2f206cbe567e77b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_c099988d7bdc415ab2f206cbe567e77b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestShelveInstance-1729554378 Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: c099988d7bdc415ab2f206cbe567e77b Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestShelveInstance-1729554378 Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestShelveInstance-1729554378-project Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: a47eeee1d19f4deb9402314872f7ba30 Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestShelveInstance-1729554378-project Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 102aa75e-21d3-415e-9a04-d44e46ca9308 could not be found. Jun 16 16:50:35.335691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '102aa75e-21d3-415e-9a04-d44e46ca9308'} Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102aa75e-21d3-415e-9a04-d44e46ca9308 could not be found. Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:50:35.336561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102aa75e-21d3-415e-9a04-d44e46ca9308 could not be found. Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102aa75e-21d3-415e-9a04-d44e46ca9308 could not be found. Jun 16 16:50:35.337836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:35.338955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Returning 404 to user: Instance 102aa75e-21d3-415e-9a04-d44e46ca9308 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:50:35.338955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cc03ec90-9e6e-4330-922e-76267e83e548 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308" status: 404 len: 111 microversion: 2.1 time: 0.031956 Jun 16 16:50:35.338955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 546/911] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:35 2022] GET /compute/v2.1/servers/102aa75e-21d3-415e-9a04-d44e46ca9308 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:50:35.545480 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3e81757d-c4a7-489f-8f97-4716dae93c74 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] Calling method '.version_select at 0x7fe5f8c30670>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:35.573732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3e81757d-c4a7-489f-8f97-4716dae93c74 tempest-TestShelveInstance-1729554378 tempest-TestShelveInstance-1729554378-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1503021758" status: 202 len: 0 microversion: 2.1 time: 0.032006 Jun 16 16:50:35.574576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 547/912] 10.222.0.74 () {58 vars in 1253 bytes} [Thu Jun 16 16:50:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1503021758 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:50:36.126161 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:36.126811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:36.137389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:36.137831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:36.138597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:36.139022 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:36.274829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:36.282875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e37b20cd-e6e7-4b4d-8971-66ff64d33dac tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1521 microversion: 2.1 time: 0.160725 Jun 16 16:50:36.283482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 548/913] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:36 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:36.288110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:36.288909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:36.295318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:36.295770 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:36.296535 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:36.296966 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:36.311581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] HTTP exception thrown: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Request method failure captured: Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 HTTP/1.1 Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq14rjYEqpLx_inEHgBTxGxsrBN2k83x37FmhAN5yTItgX1ExLvy9nKoxAUdyhfA_VX2WN1YCuA0tnykvxt8AtAt228YGWAs2y7p5PCenJP8axnTeQ7b9fANh0iwnSTqqIKbIr_LbxXUhp44jBhAsm6uENkdvyT59ilG2bi_RwlNeVUg Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:50:36.313155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestVolumeBootPattern-138176052 Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d162fcafed2c4ae099a5786cceb84891 Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:50:36.314862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '8e74018d-237a-4638-972d-b5b85e487dc5'} Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:50:36.315688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:50:36.317054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:36.318169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Returning 404 to user: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:50:36.318169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-888ed95e-c52f-4c1f-a5ee-5547f7311267 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 404 len: 111 microversion: 2.1 time: 0.030152 Jun 16 16:50:36.318169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 549/914] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:36 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:50:36.413712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-286233518", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-863924614", "security_groups": [{"name": "tempest-secgroup-smoke-2010524793"}], "block_device_mapping_v2": [{"uuid": "e61b905c-28b4-405f-9317-50db2a7db104", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58debe88-786d-44f3-b73a-fe19aa3ec834"}]}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:50:36.526530 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] validate_networks() for [('58debe88-786d-44f3-b73a-fe19aa3ec834', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:50:36.906941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:50:36.907458 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:50:36.907998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:50:36.908471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:50:36.908945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:50:36.918938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:36.919414 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:36.920212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:36.920643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:36.938548 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:50:36.943041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for user d162fcafed2c4ae099a5786cceb84891 and project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:50:37.014985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:50:37.017186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e61b905c-28b4-405f-9317-50db2a7db104',volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:50:37.170568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d09ff08a-23ec-4ad0-b8a5-05002e439dad tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760252 Jun 16 16:50:37.171473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 550/915] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:50:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:50:37.181558 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3393d1d3-13f0-4f8e-978f-8ce0d34e3038 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:37.182522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3393d1d3-13f0-4f8e-978f-8ce0d34e3038 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:37.246787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3393d1d3-13f0-4f8e-978f-8ce0d34e3038 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:37.254315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3393d1d3-13f0-4f8e-978f-8ce0d34e3038 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1093 microversion: 2.1 time: 0.076782 Jun 16 16:50:37.263790 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 551/916] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:37 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:37.300065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:37.300764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:37.307069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:37.307641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:37.308279 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:37.308769 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:37.341870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:37.342502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:37.343333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lazy-loading 'fault' on Instance uuid 9f65e809-f39a-49b7-9749-16db6f08c895 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:50:37.393544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86f1f2722c5c4da59fd83036ce1700e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907423ad5f14bf9a0680c9cdb78c995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:37.404179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4edcd1a4-7955-4187-b08b-e2c76301d6b1 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 200 len: 1312 microversion: 2.1 time: 0.107741 Jun 16 16:50:37.405244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 552/917] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:37 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 1312 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:38.368903 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:38.370143 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:38.376834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:38.377397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:38.378266 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:38.379033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:38.450891 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:38.459913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-306e37ac-4d30-45ae-898c-a502e74b1141 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1209 microversion: 2.1 time: 0.192237 Jun 16 16:50:38.469849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 553/918] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:38 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1209 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:38.475177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:38.475771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] [instance: 9f65e809-f39a-49b7-9749-16db6f08c895] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:38.482104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:38.482546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:38.483329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:38.483778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:38.498374 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] HTTP exception thrown: Instance 9f65e809-f39a-49b7-9749-16db6f08c895 could not be found. Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Request method failure captured: Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 HTTP/1.1 Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq11ro5b6A7FX6ganUFkpAtzCii9mMuj67uU_EJNeKXyOVPEi11CdokpdBemuXsxHJ3EWXeF6Gk6i83UtOmjUgKcNggIs7XNblR-5bgNopCBBFauzxp28j6cQ1iAIDY97oyTWK_pk6Wim5GNajqAEYXr3_6QO1M8H2BAoUD6g3UGqsMo Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:50:38.500255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0907423ad5f14bf9a0680c9cdb78c995"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0907423ad5f14bf9a0680c9cdb78c995 Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-820714289 Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 86f1f2722c5c4da59fd83036ce1700e1 Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-ServerRescueNegativeTestJSON-820714289-project Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 9f65e809-f39a-49b7-9749-16db6f08c895 could not be found. Jun 16 16:50:38.501884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '9f65e809-f39a-49b7-9749-16db6f08c895'} Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f65e809-f39a-49b7-9749-16db6f08c895 could not be found. Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:50:38.502757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f65e809-f39a-49b7-9749-16db6f08c895 could not be found. Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f65e809-f39a-49b7-9749-16db6f08c895 could not be found. Jun 16 16:50:38.504961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:50:38.506278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] Returning 404 to user: Instance 9f65e809-f39a-49b7-9749-16db6f08c895 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:50:38.506278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-abe2d1b7-71e1-4eb0-8eea-c044814651e3 tempest-ServerRescueNegativeTestJSON-820714289 tempest-ServerRescueNegativeTestJSON-820714289-project] 10.222.0.74 "GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895" status: 404 len: 111 microversion: 2.1 time: 0.030550 Jun 16 16:50:38.506278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 554/919] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:38 2022] GET /compute/v2.1/servers/9f65e809-f39a-49b7-9749-16db6f08c895 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:50:39.477192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:39.477798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:39.489003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:39.490833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:39.492506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:39.493008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:39.613904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:39.624013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4215ce9b-b131-4881-977d-28abba3a9be7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1197 microversion: 2.1 time: 0.150232 Jun 16 16:50:39.625245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 555/920] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:39 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:40.644220 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:40.645396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:40.653162 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:40.654080 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:40.654994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:40.655546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:40.872517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:40.881504 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-018b04c5-7e60-4444-a5c4-90690c7ec1a0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.243501 Jun 16 16:50:40.882177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 556/921] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:40 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:41.898905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:41.899580 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:41.906309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:41.906756 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:41.907733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:41.908163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:42.247415 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:42.255908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6a9803c4-1f31-420c-bbfc-0e7c9ea6df5c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.361230 Jun 16 16:50:42.256477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 557/922] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:41 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:43.274596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:43.275381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:43.287185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:43.289551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:43.292342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:43.294870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:43.471409 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:43.480072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5a1ab683-87ec-4eaa-97a7-a167ac90f1cf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.211680 Jun 16 16:50:43.480669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 558/923] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:43 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:44.497718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:44.498923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:44.508216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:44.508570 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:44.514599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:44.515182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:44.821371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:44.832516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-954adcd9-fd71-4041-8390-7242fe9d2990 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.338395 Jun 16 16:50:44.843323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 559/924] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:44 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:45.501258 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:50:45.501861 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:50:45.849873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:45.850513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:45.858246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:45.859010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:45.859817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:45.860455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:46.161206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:46.178261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2f03ad6d-8102-46e9-b0cd-6f65e130b9c4 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.332224 Jun 16 16:50:46.183100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 560/925] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:45 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:47.196810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:47.197477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:47.202051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:47.206709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:47.206977 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:47.207732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:47.208165 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:47.251019 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=8 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:47.432505 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:47.437293 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:47.443005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9c7273c8-5804-48af-96a3-06f24d2efd75 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.250149 Jun 16 16:50:47.443727 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 561/926] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:47 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:48.460761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:48.462167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:48.471042 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:48.471723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:48.472787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:48.473309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:48.783474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:48.792876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c4cdd160-d6cf-44b1-a9b6-31470aeb16e5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.336648 Jun 16 16:50:48.803361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 562/927] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:48 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:48.809639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-654135bd-0a14-4452-9dbe-4642ae8bd801 req-d7e315fd-0cf3-45ac-b5c3-b40183e47263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76e921c-2e7d-4724-aea0-959173d115c6", "name": "network-vif-plugged", "status": "completed", "tag": "1b6f4fb1-8296-41be-95a6-2cb715710627"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:50:48.820315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-654135bd-0a14-4452-9dbe-4642ae8bd801 req-d7e315fd-0cf3-45ac-b5c3-b40183e47263 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:48.820747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-654135bd-0a14-4452-9dbe-4642ae8bd801 req-d7e315fd-0cf3-45ac-b5c3-b40183e47263 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:48.833294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-654135bd-0a14-4452-9dbe-4642ae8bd801 req-d7e315fd-0cf3-45ac-b5c3-b40183e47263 service nova] Creating event network-vif-plugged:1b6f4fb1-8296-41be-95a6-2cb715710627 for instance e76e921c-2e7d-4724-aea0-959173d115c6 on hv-cinder-83735 Jun 16 16:50:48.838950 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-654135bd-0a14-4452-9dbe-4642ae8bd801 req-d7e315fd-0cf3-45ac-b5c3-b40183e47263 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033985 Jun 16 16:50:48.840341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 563/928] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:50:49.659230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4bdbf783-06eb-4641-85f2-a7ac5f7e7dd8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'create', calling method: .version_select at 0x7fe5f8b0eaf0>, body: {"keypair": {"name": "tempest-keypair-803147277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLMT9e91i4pVNgcSkdZ+rylgJfxww+62JIODku2z5mGXzm+kFFY3MqNubR8f09zAyMX0dfNNxLPc3Tf7EKeLKclh/2FfzEpXCo/kVAHesLJzki9K4dJgSgG8neRjRTyeqw=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:50:49.673794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-4bdbf783-06eb-4641-85f2-a7ac5f7e7dd8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for project 992e429cb62643a1885c29538604ae5d. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:50:49.678242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-4bdbf783-06eb-4641-85f2-a7ac5f7e7dd8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for user d5d5414645ec47e1bcaa56860ba6daf6 and project 992e429cb62643a1885c29538604ae5d. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:50:49.703599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4bdbf783-06eb-4641-85f2-a7ac5f7e7dd8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.172613 Jun 16 16:50:49.704218 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 564/929] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:50:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:50:49.810834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:49.811745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:49.819940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:49.820501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:49.821415 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:49.822013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:49.989926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:49.997888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-13a52fd5-d4ff-4984-91cc-9bd50d59831c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1265 microversion: 2.1 time: 0.191023 Jun 16 16:50:50.020862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 565/930] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:49 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:51.016925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:51.017549 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:51.025308 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:51.025763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:51.026565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:51.026993 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:51.179449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:51.187810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8665053d-e609-43de-9387-784a5fcd506f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1452 microversion: 2.1 time: 0.176161 Jun 16 16:50:51.188486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 566/931] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:51 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:51.194897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-969744974", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a239aaf5-accc-43f5-a202-3a023f480930"}], "security_groups": [{"name": "tempest-securitygroup--17727980"}], "key_name": "tempest-keypair-803147277", "user_data": "}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:50:51.302281 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] validate_networks() for [('a239aaf5-accc-43f5-a202-3a023f480930', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:50:51.714671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:50:51.715335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:50:51.715598 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:50:51.716162 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:50:51.716385 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:50:51.727620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:51.728053 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:51.729259 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:51.729692 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:51.747630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for project 992e429cb62643a1885c29538604ae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:50:51.751617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for user d5d5414645ec47e1bcaa56860ba6daf6 and project 992e429cb62643a1885c29538604ae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:50:51.764418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:50:51.766690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:50:51.815402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-676af50c-1142-4337-8724-475b678a3f83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.625572 Jun 16 16:50:51.816049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 567/932] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:50:51 2022] POST /compute/v2.1/servers => generated 400 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:50:51.820590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:51.821192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:51.830214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:51.830715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:51.831508 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:51.831942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:51.998185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:52.006850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ca6d188e-12b1-4271-b2f7-1f38e8fa60f3 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1452 microversion: 2.1 time: 0.189757 Jun 16 16:50:52.007833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 568/933] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:51 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:52.012876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0541ac3a-e3df-43a2-9ca6-04f556618518 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:52.013764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0541ac3a-e3df-43a2-9ca6-04f556618518 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:52.022933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:50:52.085029 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0541ac3a-e3df-43a2-9ca6-04f556618518 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:52.097450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0541ac3a-e3df-43a2-9ca6-04f556618518 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1236 microversion: 2.1 time: 0.088343 Jun 16 16:50:52.108005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 569/934] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:52 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1236 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:53.117576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:53.118237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:53.135982 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:53.137233 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:53.138101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:53.138527 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:53.269268 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:53.279215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1c0f62db-327f-44b9-96af-4452f99f4198 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1294 microversion: 2.1 time: 0.168941 Jun 16 16:50:53.279963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 570/935] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:53 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:54.297067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:54.297786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:54.305721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:54.306167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:54.306949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:54.307411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:54.373484 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:54.381617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c4ef570c-7312-4145-845d-6976d71fe45a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1294 microversion: 2.1 time: 0.088461 Jun 16 16:50:54.382179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 571/936] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:54 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1294 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:55.398578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:55.399287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:55.418359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:55.421664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:55.422608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:55.423181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:55.585264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:55.593125 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c409c014-653a-44d6-b707-3bcb54cbcee6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.198879 Jun 16 16:50:55.593707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 572/937] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:55 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:56.612448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:56.613242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:56.621948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:56.622533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:56.623563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:56.624125 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:56.766312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:56.774844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ac2ce159-e2a0-4e18-b66d-dc4ffa0dc8ef tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.167651 Jun 16 16:50:56.775463 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 573/938] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:56 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:57.793526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:57.794319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:57.803611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:57.804087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:57.805036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:57.805572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:57.954236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:57.962304 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-62098c88-5f95-44ef-9ef0-aacc59148d0e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.173718 Jun 16 16:50:57.962890 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 574/939] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:57 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:50:58.979807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:58.980520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:58.987925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:58.988367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:58.989137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:58.989566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:59.126728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:50:59.134456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4e47733f-8b1a-4ce9-86cf-68e1dcaf1edd tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.158749 Jun 16 16:50:59.135016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 575/940] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:50:58 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:50:59.680630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ae8c7a55-e2aa-4887-a86f-58ac416fa97a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:50:59.681120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ae8c7a55-e2aa-4887-a86f-58ac416fa97a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:50:59.687312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae8c7a55-e2aa-4887-a86f-58ac416fa97a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:59.687759 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae8c7a55-e2aa-4887-a86f-58ac416fa97a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:59.688508 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae8c7a55-e2aa-4887-a86f-58ac416fa97a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:50:59.688933 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae8c7a55-e2aa-4887-a86f-58ac416fa97a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:50:59.715599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ae8c7a55-e2aa-4887-a86f-58ac416fa97a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/ips" status: 200 len: 149 microversion: 2.1 time: 0.186681 Jun 16 16:50:59.716146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 576/941] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:50:59 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/ips => generated 149 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:51:00.151947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:00.152629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:00.159934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:00.160501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:00.161334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:00.161861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:00.296788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:00.305201 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d70b93f1-ada9-4e1c-9601-7ec8a8b1f1b9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.157222 Jun 16 16:51:00.305894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 577/942] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:00 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:01.056511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f705eff5-4494-4a5b-adb3-9f2e57b3e133 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e4874b7-b56d-43d6-bdb4-53f82694c884"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:01.057652 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f705eff5-4494-4a5b-adb3-9f2e57b3e133 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:01.064365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f705eff5-4494-4a5b-adb3-9f2e57b3e133 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:01.064762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f705eff5-4494-4a5b-adb3-9f2e57b3e133 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:01.065764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f705eff5-4494-4a5b-adb3-9f2e57b3e133 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:01.066199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f705eff5-4494-4a5b-adb3-9f2e57b3e133 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:01.351423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f705eff5-4494-4a5b-adb3-9f2e57b3e133 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298702 Jun 16 16:51:01.352973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 578/943] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:51:01 2022] POST /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:51:01.358587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:01.359467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:01.366339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:01.367159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:01.369402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:01.370027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:01.520539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:01.528720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c4cfa6ce-ff4e-48c8-aeb3-4015becbbe1f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.174126 Jun 16 16:51:01.529285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 579/944] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:01 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:02.290049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-5961e3da-ebc4-4b65-8243-0087aa423ae5 req-87183192-df2f-43fd-ac2c-cd781377919d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a11b21-2cf2-45f9-9726-a3f7d7c191ae", "name": "network-vif-plugged", "status": "completed", "tag": "70531c65-24e2-4f59-8bac-070440cfec7e"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:02.295503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:02.296222 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=12 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:02.302179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5961e3da-ebc4-4b65-8243-0087aa423ae5 req-87183192-df2f-43fd-ac2c-cd781377919d service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:02.302960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5961e3da-ebc4-4b65-8243-0087aa423ae5 req-87183192-df2f-43fd-ac2c-cd781377919d service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:02.319240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-5961e3da-ebc4-4b65-8243-0087aa423ae5 req-87183192-df2f-43fd-ac2c-cd781377919d service nova] Creating event network-vif-plugged:70531c65-24e2-4f59-8bac-070440cfec7e for instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae on hv-cinder-83735 Jun 16 16:51:02.324272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-5961e3da-ebc4-4b65-8243-0087aa423ae5 req-87183192-df2f-43fd-ac2c-cd781377919d service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038755 Jun 16 16:51:02.325337 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 580/945] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:51:02.547183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:02.547906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:02.555314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:02.556100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:02.557432 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:02.558206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:02.579095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:02.713876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:02.721715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7c42d0ff-f7b8-423b-94a1-9eb4bdefea0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.179201 Jun 16 16:51:02.722287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 581/946] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:02 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:51:03.740203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:03.740851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:03.747766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:03.748209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:03.748964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:03.749400 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:03.881762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:03.889805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0702da17-789c-4cd0-b18b-aa487edb9b83 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1360 microversion: 2.1 time: 0.154489 Jun 16 16:51:03.890374 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 582/947] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:03 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1360 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:04.910611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:04.911788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:04.922601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:04.923368 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:04.924210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:04.924638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:05.075871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:05.084706 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e5a1c11e-ccd2-4b28-9e75-50cfc1633709 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1544 microversion: 2.1 time: 0.180403 Jun 16 16:51:05.085280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 583/948] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:04 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1544 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:05.100870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a08342d9-312a-4676-bec6-db4b7c4ffdee tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:05.101401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a08342d9-312a-4676-bec6-db4b7c4ffdee tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:05.107737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a08342d9-312a-4676-bec6-db4b7c4ffdee tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:05.108187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a08342d9-312a-4676-bec6-db4b7c4ffdee tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:05.108963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a08342d9-312a-4676-bec6-db4b7c4ffdee tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:05.109391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a08342d9-312a-4676-bec6-db4b7c4ffdee tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:05.189036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a08342d9-312a-4676-bec6-db4b7c4ffdee tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091790 Jun 16 16:51:05.189699 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 584/949] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:51:05 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:51:05.652012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8de894ee-990b-4a85-bb7f-ec5e5bfec8df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:05.652498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8de894ee-990b-4a85-bb7f-ec5e5bfec8df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:05.659625 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8de894ee-990b-4a85-bb7f-ec5e5bfec8df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:05.660067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8de894ee-990b-4a85-bb7f-ec5e5bfec8df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:05.660828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8de894ee-990b-4a85-bb7f-ec5e5bfec8df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:05.661254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8de894ee-990b-4a85-bb7f-ec5e5bfec8df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:05.686086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8de894ee-990b-4a85-bb7f-ec5e5bfec8df tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/ips" status: 200 len: 151 microversion: 2.20 time: 0.194730 Jun 16 16:51:05.686653 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 585/950] 10.222.0.74 () {60 vars in 1288 bytes} [Thu Jun 16 16:51:05 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/ips => generated 151 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:51:06.394906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-6cbf5500-8253-4491-a5c3-174b47cccd66 req-083b67b8-8758-49e0-92ff-edc39b39dcfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53a11b21-2cf2-45f9-9726-a3f7d7c191ae", "tag": "70531c65-24e2-4f59-8bac-070440cfec7e"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:06.404226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6cbf5500-8253-4491-a5c3-174b47cccd66 req-083b67b8-8758-49e0-92ff-edc39b39dcfd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:06.404763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6cbf5500-8253-4491-a5c3-174b47cccd66 req-083b67b8-8758-49e0-92ff-edc39b39dcfd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:06.416599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-6cbf5500-8253-4491-a5c3-174b47cccd66 req-083b67b8-8758-49e0-92ff-edc39b39dcfd service nova] Creating event network-changed:70531c65-24e2-4f59-8bac-070440cfec7e for instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae on hv-cinder-83735 Jun 16 16:51:06.421941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-6cbf5500-8253-4491-a5c3-174b47cccd66 req-083b67b8-8758-49e0-92ff-edc39b39dcfd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030871 Jun 16 16:51:06.422560 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 586/951] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:51:07.702523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:07.703413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:07.713622 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:07.714256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:07.715375 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:07.716020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:07.741947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lazy-loading 'flavor' on Instance uuid bbc30a47-0cf1-4fae-b736-0f67761e2150 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:51:08.026911 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9f96a443-44d7-4290-979f-521148c4f735 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/action" status: 202 len: 0 microversion: 2.20 time: 0.330496 Jun 16 16:51:08.027593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 587/952] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Jun 16 16:51:07 2022] POST /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:51:08.037270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:08.037959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:08.045038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:08.045479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:08.046238 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:08.046674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:08.182468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:08.191263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:08.192767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:08.193937 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0516a8e2-9049-4e0b-b5dd-5308f832da13 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.160614 Jun 16 16:51:08.194499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 588/953] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:08 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:08.894810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e4874b7-b56d-43d6-bdb4-53f82694c884"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:08.896290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:08.903455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:08.903897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:08.904656 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:08.905103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:08.989964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Invalid volume: volume 4e4874b7-b56d-43d6-bdb4-53f82694c884 is already attached to instances: a73efd2c-4bd0-4f43-a720-aa81521289a8 Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: POST /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments HTTP/1.1 Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 74 Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:51:08.991746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {"volumeAttachment": {"volumeId": "4e4874b7-b56d-43d6-bdb4-53f82694c884"}} Jun 16 16:51:08.993226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Invalid volume: volume 4e4874b7-b56d-43d6-bdb4-53f82694c884 is already attached to instances: a73efd2c-4bd0-4f43-a720-aa81521289a8 Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'server_id': 'a73efd2c-4bd0-4f43-a720-aa81521289a8', 'body': {'volumeAttachment': {'volumeId': '4e4874b7-b56d-43d6-bdb4-53f82694c884'}}} Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e4874b7-b56d-43d6-bdb4-53f82694c884 is already attached to instances: a73efd2c-4bd0-4f43-a720-aa81521289a8 Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:08.994035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e4874b7-b56d-43d6-bdb4-53f82694c884 is already attached to instances: a73efd2c-4bd0-4f43-a720-aa81521289a8 Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:51:08.995339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e4874b7-b56d-43d6-bdb4-53f82694c884 is already attached to instances: a73efd2c-4bd0-4f43-a720-aa81521289a8 Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 400 to user: Invalid volume: volume 4e4874b7-b56d-43d6-bdb4-53f82694c884 is already attached to instances: a73efd2c-4bd0-4f43-a720-aa81521289a8 {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc3c0673-5616-4bcf-80f7-5103c061fae2 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102596 Jun 16 16:51:08.996572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 589/954] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:51:08 2022] POST /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:51:09.069807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:09.070296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:09.076748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:09.077195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:09.077964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:09.078423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:09.166109 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lazy-loading 'services' on Instance uuid a73efd2c-4bd0-4f43-a720-aa81521289a8 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:51:09.245798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4ba9ca55-f826-4623-9eab-9a7d05a96e4d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments/4e4874b7-b56d-43d6-bdb4-53f82694c884" status: 202 len: 0 microversion: 2.1 time: 0.179886 Jun 16 16:51:09.246494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 590/955] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:51:09 2022] DELETE /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments/4e4874b7-b56d-43d6-bdb4-53f82694c884 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:51:09.251961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:09.252657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:09.259141 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:09.259581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:09.260356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:09.260807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:09.401639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:09.410054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:09.411582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:09.412749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f7cb196b-0b5c-491f-bab1-84dda41096c7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.165007 Jun 16 16:51:09.413318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 591/956] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:09 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:09.418135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9204e0a6-00c6-4127-a986-7defde99894d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:09.419065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9204e0a6-00c6-4127-a986-7defde99894d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:09.425273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9204e0a6-00c6-4127-a986-7defde99894d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:09.425716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9204e0a6-00c6-4127-a986-7defde99894d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:09.426474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9204e0a6-00c6-4127-a986-7defde99894d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:09.426901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9204e0a6-00c6-4127-a986-7defde99894d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:09.457376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9204e0a6-00c6-4127-a986-7defde99894d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043042 Jun 16 16:51:09.457954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 592/957] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:51:09 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:51:10.431747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:10.432454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:10.439378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.439820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:10.440607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.441025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:10.578679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:10.591410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:10.593723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:10.595420 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d2ea80e6-1386-4fd3-a90d-097a05299e3d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.167649 Jun 16 16:51:10.595996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 593/958] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:10 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:10.600535 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-51374796-02b1-4fca-af7d-ef655d0a679c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:10.601445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-51374796-02b1-4fca-af7d-ef655d0a679c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:10.607753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51374796-02b1-4fca-af7d-ef655d0a679c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.608380 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51374796-02b1-4fca-af7d-ef655d0a679c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:10.609158 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51374796-02b1-4fca-af7d-ef655d0a679c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.609588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51374796-02b1-4fca-af7d-ef655d0a679c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:10.640330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-51374796-02b1-4fca-af7d-ef655d0a679c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043264 Jun 16 16:51:10.640881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 594/959] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:51:10 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:51:10.710131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:10.710818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:10.720605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.721041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:10.721810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.722209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:10.753854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:51:10.789479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:10.837992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-72122b7f-7bdc-460c-87e0-58ed2da6e8f9 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 204 len: 0 microversion: 2.1 time: 0.134312 Jun 16 16:51:10.838805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 595/960] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:51:10 2022] DELETE /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:51:10.848104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:10.848809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:10.854808 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.855287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:10.856088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:10.856457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:11.005428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:11.016676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c3d3169c-064d-4e8e-a74a-2b05e603e101 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1678 microversion: 2.1 time: 0.173099 Jun 16 16:51:11.017348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 596/961] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:10 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:51:11.614347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:11.614937 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:11.622311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:11.622757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:11.623567 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:11.624006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:11.768009 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:11.780174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:11.782001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:11.783698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ada46aaa-872d-465d-84b2-d53350f34504 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.173197 Jun 16 16:51:11.784274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 597/962] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:11 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:12.035821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:12.036457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:12.043340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:12.043804 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:12.044623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:12.045077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:12.197788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:12.210576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-71d6177b-7632-49fa-9798-1c3ded5bbd89 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1678 microversion: 2.1 time: 0.179334 Jun 16 16:51:12.211469 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 598/963] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:12 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:12.805724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:12.806412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:12.814203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:12.814682 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:12.815477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:12.815906 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:12.967026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:12.976885 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:12.979253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:12.980513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cb04f529-defb-41eb-b2a2-0e9137b9d0b2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.179028 Jun 16 16:51:12.981088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 599/964] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:12 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:13.232483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:13.233126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:13.239737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:13.240185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:13.240948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:13.241381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:13.375890 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:13.383538 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-08f1480c-2d38-47ae-ba57-86f532f1042a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 200 len: 1678 microversion: 2.1 time: 0.155609 Jun 16 16:51:13.384192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 600/965] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:13 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:13.999625 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:14.000342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:14.007314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:14.007758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:14.008542 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:14.008911 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:14.142031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:14.150731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:14.152260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:14.153462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bfa029ee-418d-46c4-8907-2191a4c91db4 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.157945 Jun 16 16:51:14.154024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 601/966] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:13 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:14.401518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:14.402443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:14.409394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:14.409953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:14.410867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:14.411378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:14.425210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 HTTP/1.1 Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:51:14.427131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:51:14.428778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'a73efd2c-4bd0-4f43-a720-aa81521289a8'} Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:51:14.430531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:51:14.432106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:51:14.433559 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:51:14.433559 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-321b4700-2de3-4a11-8a30-a8cc07c04512 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 404 len: 111 microversion: 2.1 time: 0.031189 Jun 16 16:51:14.436362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 602/967] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:14 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:51:14.441627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ddaef85b-352b-4699-b8c1-265b193aefa6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '.version_select at 0x7fe5fd36dc10>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:14.462525 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ddaef85b-352b-4699-b8c1-265b193aefa6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-763099429" status: 202 len: 0 microversion: 2.1 time: 0.024728 Jun 16 16:51:14.463166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 603/968] 10.222.0.74 () {58 vars in 1217 bytes} [Thu Jun 16 16:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-763099429 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:51:15.092898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e1d167ab-26df-4025-a3c2-db88259317eb tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: .version_select at 0x7fe5f8c1b550>, body: {"keypair": {"name": "tempest-keypair-293494010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIDtEGrf1w9xwMkNgoi02ZSTFAl9syQ9TCry9/KxZblnpvamUM9HOREFBwJdvXjahpgzIb/CdJ5OmfWdmT6b9EJopYkpMUqhMnSHg6t8k3y9t9wf4eHxWVkosaClo66s/w=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:15.109282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-e1d167ab-26df-4025-a3c2-db88259317eb tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:51:15.113195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-e1d167ab-26df-4025-a3c2-db88259317eb tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:51:15.139134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e1d167ab-26df-4025-a3c2-db88259317eb tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052966 Jun 16 16:51:15.139796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 604/969] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:51:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:51:15.172634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:15.173476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:15.180333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:15.180816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:15.181585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:15.181992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:15.347460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:15.355870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:15.357518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:15.358780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-02175a96-906b-4a32-bb04-d54db84ae6e1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.190475 Jun 16 16:51:15.359376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 605/970] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:15 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:16.378462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:16.379162 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:16.386015 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:16.386447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:16.387477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:16.387916 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:16.528794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:16.538044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:16.539589 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:16.540940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-84834118-3d09-4326-b4b9-4fe635a20887 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.166902 Jun 16 16:51:16.541503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 606/971] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:16 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:16.546386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-451768922", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e1f0da2-a24e-4041-9def-f84f18fbaf90"}], "security_groups": [{"name": "tempest-securitygroup--682545033"}], "key_name": "tempest-keypair-293494010", "user_data": "}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:16.665118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] validate_networks() for [('9e1f0da2-a24e-4041-9def-f84f18fbaf90', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:51:17.066922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:51:17.067411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:51:17.067863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:51:17.068288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:51:17.068705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:51:17.078477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:17.079532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:17.080354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:17.080784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:17.092271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:17.099784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:51:17.104621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Getting quotas for user b49313559188427bb9f42068583a8292 and project 8725edcf74cc463cafe3614a3bd880e6. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:51:17.117423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:51:17.119746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:51:17.170565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bd61cca5-867a-4688-ae67-6977854c6286 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.628023 Jun 16 16:51:17.171251 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 607/972] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:51:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:51:17.181235 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-65e0030c-9bc1-4e65-a8d1-6f707ad4a9b6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:17.181851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-65e0030c-9bc1-4e65-a8d1-6f707ad4a9b6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:17.235082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-65e0030c-9bc1-4e65-a8d1-6f707ad4a9b6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:17.242534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-65e0030c-9bc1-4e65-a8d1-6f707ad4a9b6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1240 microversion: 2.1 time: 0.065147 Jun 16 16:51:17.243158 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 608/973] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:17 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:17.560409 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:17.561033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:17.569290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:17.569742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:17.570665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:17.571274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:17.710100 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:17.720691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:17.723123 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:17.724963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6ca7ca46-938f-4d55-81bf-dc226ea7200d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.168881 Jun 16 16:51:17.725788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 609/974] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:17 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:18.259584 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:18.260188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:18.266598 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:18.267030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:18.267809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:18.268226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:18.345747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:18.353976 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-55b13345-48e7-4f88-b027-6156b0bc17dc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1292 microversion: 2.1 time: 0.098454 Jun 16 16:51:18.354782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 610/975] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:18 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1292 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:18.743981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:18.744664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:18.752150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:18.752582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:18.754250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:18.754250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:18.887501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:18.896087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:18.897586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:18.898758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7fa5a525-5b53-4e2a-a25a-b0cc92f350be tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.158830 Jun 16 16:51:18.899543 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 611/976] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:18 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:19.371516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:19.372124 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:19.378968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:19.379664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:19.380436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:19.380859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:19.516655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:19.524975 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ba745fa0-13f4-4a90-a5c8-eec564451370 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.157408 Jun 16 16:51:19.525764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 612/977] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:19 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:51:19.918574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:19.919281 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:19.927235 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:19.928025 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:19.928834 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:19.929270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:20.087027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:20.096003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:20.097656 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:20.098928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ebb37ceb-499e-4f40-9c25-3a38f770426b tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.184908 Jun 16 16:51:20.099557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 613/978] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:19 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:20.542221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:20.542745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:20.551040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:20.551326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:20.552133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:20.552570 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:20.694234 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:20.702643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cbd509fb-5a60-42b1-a42a-01941b63cd1a tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.164383 Jun 16 16:51:20.703324 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 614/979] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:20 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:21.118405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:21.119127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:21.126780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:21.127270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:21.128048 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:21.128484 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:21.276252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:21.286282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:21.287832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:21.289006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6e33f389-a2e8-49f2-a838-5690f1d8230d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.174909 Jun 16 16:51:21.289546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 615/980] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:21 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:21.721513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:21.722120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:21.728817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:21.729264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:21.730018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:21.730448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:21.734468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:21.869823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:21.877547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1b3f20bd-89b8-4880-b2a6-10aadc8ef12b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.160272 Jun 16 16:51:21.878126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 616/981] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:21 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:22.311152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:22.312202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:22.323693 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:22.324412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:22.325651 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:22.326352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:22.462798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:22.475767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:22.478111 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:22.480118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0d68b1da-876a-4187-a226-14a8a3eed3c6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.175278 Jun 16 16:51:22.480995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 617/982] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:22 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:22.896159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:22.897149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:22.903974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:22.904408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:22.905153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:22.905573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:23.051375 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:23.062497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-90558eaf-a88b-4473-825e-4f6a88de54b5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.171378 Jun 16 16:51:23.063263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 618/983] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:22 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:51:23.501351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:23.501947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:23.509045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:23.509488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:23.510248 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:23.510680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:23.646653 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:23.656378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:23.658660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:23.660116 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f55d2864-74f3-4f75-8fdf-5ad31cddec4f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.164615 Jun 16 16:51:23.660715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 619/984] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:23 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:24.084918 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:24.085566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:24.093745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:24.094561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:24.095475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:24.095912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:24.245496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:24.254408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bff44f4b-6362-465e-b361-24fe154f7f92 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.174476 Jun 16 16:51:24.255271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 620/985] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:24 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:24.684178 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:24.684928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:24.692915 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:24.693428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:24.694303 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:24.694798 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:24.838270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:24.846874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:24.848395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:24.849555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ac3b2ea6-e8e9-478c-b730-e25e07f76394 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.170325 Jun 16 16:51:24.850110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 621/986] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:24 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:25.272072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:25.272675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:25.279663 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:25.280101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:25.280865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:25.281845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:25.419482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:25.428620 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a76cd257-45de-4bc9-8e67-791b2dc1f7a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.160638 Jun 16 16:51:25.429406 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 622/987] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:25 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:25.870309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:25.871136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:25.879111 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:25.879594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:25.880364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:25.880793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:26.019120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:26.031965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:26.034340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:26.036179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f40921c2-b054-438a-a7cd-2e3907b1c9b1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1744 microversion: 2.20 time: 0.170322 Jun 16 16:51:26.036938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 623/988] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:25 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:26.422841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-66bd3a79-3e3a-4c17-9425-fdb5b69a91ce req-ec92e76b-ebf4-44f8-b868-78b9fe5ab74a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0595641e-4ce1-4716-90a3-8c279a0ee3a6", "name": "network-vif-plugged", "status": "completed", "tag": "25a60624-5ea4-4fa0-94ac-9ef3101ea1e7"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:26.431363 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-66bd3a79-3e3a-4c17-9425-fdb5b69a91ce req-ec92e76b-ebf4-44f8-b868-78b9fe5ab74a service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:26.431855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-66bd3a79-3e3a-4c17-9425-fdb5b69a91ce req-ec92e76b-ebf4-44f8-b868-78b9fe5ab74a service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:26.445355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-66bd3a79-3e3a-4c17-9425-fdb5b69a91ce req-ec92e76b-ebf4-44f8-b868-78b9fe5ab74a service nova] Creating event network-vif-plugged:25a60624-5ea4-4fa0-94ac-9ef3101ea1e7 for instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 on hv-cinder-83735 Jun 16 16:51:26.450610 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-66bd3a79-3e3a-4c17-9425-fdb5b69a91ce req-ec92e76b-ebf4-44f8-b868-78b9fe5ab74a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032025 Jun 16 16:51:26.451262 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 624/989] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:51:26.456594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:26.457246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:26.463585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:26.464026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:26.464786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:26.465208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:26.601780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:26.609305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-47614972-1a10-4aa3-b9de-20822cc86f2d tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.156724 Jun 16 16:51:26.610562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 625/990] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:26 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:27.063653 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:27.064345 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:27.071283 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:27.071729 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:27.072497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:27.072897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:27.089395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:27.217030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:27.225494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:27.227012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:27.228240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f5b5a720-93a5-463f-af08-e5c695e274b5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1744 microversion: 2.20 time: 0.170859 Jun 16 16:51:27.228777 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 626/991] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:27 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:27.627920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:27.628537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:27.630409 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=12 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:27.636873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:27.637318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:27.638078 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:27.638506 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:27.772870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:27.782851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b4c8a3cf-032f-4bdb-b513-7a951b1fd04b tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.159401 Jun 16 16:51:27.783667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 627/992] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:27 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:28.250104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:28.251430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:28.262718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:28.264181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:28.264619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:28.265287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:28.403686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:28.412339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:28.413842 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:28.415090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f4cb9379-9c97-4002-9fce-598ca50ef33f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1744 microversion: 2.20 time: 0.172011 Jun 16 16:51:28.415708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 628/993] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:28 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1744 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:28.801379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:28.802183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:28.809716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:28.810161 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:28.810929 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:28.811375 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:28.948870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:28.956483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1a179d1c-a41d-450b-8818-a036a22d908c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1365 microversion: 2.1 time: 0.160343 Jun 16 16:51:28.957082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 629/994] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:28 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:29.434121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:29.434820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:29.442578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:29.443041 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:29.443820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:29.444236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:29.592366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:29.600791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:29.602274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:29.603450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bab2d064-33d8-474f-8d28-970e7d16c37c tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1744 microversion: 2.20 time: 0.173720 Jun 16 16:51:29.604014 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 630/995] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:29 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:29.976081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:29.976794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:29.985569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:29.986011 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:29.986759 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:29.987217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:30.128674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:30.136437 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-af0f3e1a-3a00-4324-ad9a-b456b91d6d0c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1555 microversion: 2.1 time: 0.166643 Jun 16 16:51:30.137007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 631/996] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:51:29 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1555 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:51:30.152658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-69af16e9-7c92-4481-9cdb-5e736abfe03e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:30.153134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-69af16e9-7c92-4481-9cdb-5e736abfe03e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:30.159524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69af16e9-7c92-4481-9cdb-5e736abfe03e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:30.159958 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69af16e9-7c92-4481-9cdb-5e736abfe03e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:30.160698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69af16e9-7c92-4481-9cdb-5e736abfe03e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:30.161114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69af16e9-7c92-4481-9cdb-5e736abfe03e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:30.239709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-69af16e9-7c92-4481-9cdb-5e736abfe03e tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090213 Jun 16 16:51:30.241072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 632/997] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:51:30 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:51:30.497311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-5997ac06-6f18-4ebb-af9b-d015fdb2933c req-1daf05bb-5d7f-4572-add4-eb5e37f967f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc30a47-0cf1-4fae-b736-0f67761e2150", "name": "network-vif-plugged", "status": "completed", "tag": "3438f639-56b8-451a-81c9-c4ec1500cf56"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:30.506428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5997ac06-6f18-4ebb-af9b-d015fdb2933c req-1daf05bb-5d7f-4572-add4-eb5e37f967f1 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:30.506868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5997ac06-6f18-4ebb-af9b-d015fdb2933c req-1daf05bb-5d7f-4572-add4-eb5e37f967f1 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:30.518165 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-5997ac06-6f18-4ebb-af9b-d015fdb2933c req-1daf05bb-5d7f-4572-add4-eb5e37f967f1 service nova] Creating event network-vif-plugged:3438f639-56b8-451a-81c9-c4ec1500cf56 for instance bbc30a47-0cf1-4fae-b736-0f67761e2150 on hv-cinder-83735 Jun 16 16:51:30.524545 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-5997ac06-6f18-4ebb-af9b-d015fdb2933c req-1daf05bb-5d7f-4572-add4-eb5e37f967f1 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098876 Jun 16 16:51:30.525241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 633/998] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:51:30.622916 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:30.623626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:30.630822 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:30.631364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:30.632106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:30.632531 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:30.652578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:30.772049 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:30.780242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:30.782241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:30.783444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-021429f2-381b-43ea-8bfb-b5b123e6467a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1744 microversion: 2.20 time: 0.165057 Jun 16 16:51:30.784003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 634/999] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:30 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:31.802356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:31.803006 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:31.809867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:31.810306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:31.811098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:31.811526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:31.954418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:31.962714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:31.964259 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:31.965428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-60cf9b96-4f35-469e-b8d2-23cd401f2df1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1744 microversion: 2.20 time: 0.167152 Jun 16 16:51:31.965986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 635/1000] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:31 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1744 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:32.986603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:32.987306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:32.994268 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:32.994714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:32.995509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:32.995935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:33.136936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:33.147129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:33.148613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:33.149891 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8e235ff9-bdba-4639-953c-979ded336b47 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1744 microversion: 2.20 time: 0.168548 Jun 16 16:51:33.150456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 636/1001] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:32 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:34.169065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:34.169674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:34.177244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:34.177695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:34.178472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:34.178905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:34.336877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:34.348225 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:34.350499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:34.352183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2ba76dc7-1825-4a42-82d4-3268a3160d27 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.187152 Jun 16 16:51:34.352846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 637/1002] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:34 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:35.371367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:35.372283 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:35.379578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:35.380117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:35.381146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:35.381675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:35.544610 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:35.559074 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:35.560646 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:35.561874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cf0f7654-16b4-4e31-bf2c-dce8fa55f811 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.194462 Jun 16 16:51:35.563493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 638/1003] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:35 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:36.581444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:36.582191 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:36.588712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:36.589430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:36.590190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:36.590847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:36.732270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:36.741752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:36.743329 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:36.744718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e870e5ea-c9a3-4136-bdcf-12ef3296b854 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.167376 Jun 16 16:51:36.745268 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 639/1004] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:36 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:37.764052 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:37.765342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:37.772187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:37.772626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:37.773381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:37.773830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:37.913841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:37.925181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:37.927493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:37.928801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e2a83280-242f-41ac-8bb2-50b6c814c715 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.169112 Jun 16 16:51:37.929414 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 640/1005] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:37 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:38.948051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:38.948751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:38.955712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:38.956154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:38.956927 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:38.957375 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:39.108736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:39.117612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:39.120515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:39.122009 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4c2a02ea-9eb1-47d3-bed9-22e6a980fd40 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.177935 Jun 16 16:51:39.122624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 641/1006] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:38 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:40.141417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:40.142722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:40.157959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:40.160173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:40.160832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:40.161261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:40.304269 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:40.313170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:40.314826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:40.316196 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d1d95989-5fe5-47e9-ad2e-1500a769b7d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.178942 Jun 16 16:51:40.316644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 642/1007] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:40 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:41.334677 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:41.335764 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:41.344273 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:41.344821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:41.345612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:41.346252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:41.497214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:41.506509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:41.508341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:41.509809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ca7f9e0f-d356-49e0-8cf7-a0e395adf085 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.179383 Jun 16 16:51:41.510796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 643/1008] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:41 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:42.531675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:42.533218 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:42.540962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:42.541771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:42.542780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:42.543317 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:42.704676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:42.713030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:42.714548 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:42.715767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c2862190-5d1c-4c19-9130-bb2f358c7181 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.189974 Jun 16 16:51:42.719087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 644/1009] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:42 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:43.738788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:43.739775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:43.749968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:43.751153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:43.752306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:43.752881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:43.917809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:43.926716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:43.928277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:43.929454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d922d31a-3798-4781-8079-a78525eede20 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.199193 Jun 16 16:51:43.930192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 645/1010] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:43 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:44.948785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:44.950102 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:44.957690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:44.958431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:44.959193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:44.959780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:45.098270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:45.106816 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:45.109030 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:45.110370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c4034f36-a75f-4934-ba6e-8cb6701d72e5 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.165562 Jun 16 16:51:45.111314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 646/1011] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:44 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:46.129572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:46.130249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:46.137242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:46.137687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:46.138452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:46.138900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:46.286198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:46.294814 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:46.296455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:46.297590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a8d36a10-3c8d-41dc-91dc-7f25877d6521 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1739 microversion: 2.20 time: 0.172158 Jun 16 16:51:46.298153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 647/1012] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:46 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:47.316723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:47.317507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:47.319741 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:47.325527 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:47.325975 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:47.326837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:47.327717 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:47.467353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:47.475836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:47.477466 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:47.478635 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1253601c-b3bd-47ad-926a-469d7efa49bb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1721 microversion: 2.20 time: 0.165940 Jun 16 16:51:47.479242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 648/1013] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:47 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:48.500224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:48.500959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:48.511216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:48.511857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:48.512888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:48.513512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:48.658166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:48.669859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:48.671817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:48.672982 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1782599c-8fae-4709-8740-d7a2572bc881 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1721 microversion: 2.20 time: 0.179084 Jun 16 16:51:48.673780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 649/1014] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:48 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:49.697734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:49.698423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:49.708238 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:49.708681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:49.709694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:49.710225 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:49.852908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:49.861666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:49.863183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:49.864455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f8c7c362-40eb-40d3-b72c-4961e52693d6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1664 microversion: 2.20 time: 0.173059 Jun 16 16:51:49.865011 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 650/1015] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:49 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:49.881969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-742c071d-82f9-40e2-8c77-7af9dff3e9a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c83d81b-c2ca-470f-8e34-acce7378b2e7"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:49.883007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-742c071d-82f9-40e2-8c77-7af9dff3e9a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:49.889454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-742c071d-82f9-40e2-8c77-7af9dff3e9a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:49.889827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-742c071d-82f9-40e2-8c77-7af9dff3e9a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:49.890577 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-742c071d-82f9-40e2-8c77-7af9dff3e9a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:49.890999 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-742c071d-82f9-40e2-8c77-7af9dff3e9a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:49.895010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:50.193021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-742c071d-82f9-40e2-8c77-7af9dff3e9a9 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314815 Jun 16 16:51:50.193639 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 651/1016] 10.222.0.74 () {62 vars in 1363 bytes} [Thu Jun 16 16:51:49 2022] POST /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 16 16:51:50.327610 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-37f9b7c6-b22e-4cad-9037-c918307907d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:50.328119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-37f9b7c6-b22e-4cad-9037-c918307907d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:50.334478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-37f9b7c6-b22e-4cad-9037-c918307907d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:50.334919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-37f9b7c6-b22e-4cad-9037-c918307907d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:50.335685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-37f9b7c6-b22e-4cad-9037-c918307907d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:50.336108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-37f9b7c6-b22e-4cad-9037-c918307907d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:50.599783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-37f9b7c6-b22e-4cad-9037-c918307907d8 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-volume_attachments/1c83d81b-c2ca-470f-8e34-acce7378b2e7" status: 202 len: 0 microversion: 2.20 time: 0.276181 Jun 16 16:51:50.600389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 652/1017] 10.222.0.74 () {60 vars in 1456 bytes} [Thu Jun 16 16:51:50 2022] DELETE /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-volume_attachments/1c83d81b-c2ca-470f-8e34-acce7378b2e7 => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:51:50.607703 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-de907fd1-b074-466d-aa92-505509d72a04 req-6da39f74-e8f2-45b5-8564-64f2db8c1357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc30a47-0cf1-4fae-b736-0f67761e2150", "name": "network-vif-unplugged", "status": "completed", "tag": "3438f639-56b8-451a-81c9-c4ec1500cf56"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:50.618459 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-de907fd1-b074-466d-aa92-505509d72a04 req-6da39f74-e8f2-45b5-8564-64f2db8c1357 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:50.618904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-de907fd1-b074-466d-aa92-505509d72a04 req-6da39f74-e8f2-45b5-8564-64f2db8c1357 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:50.630588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.compute.server_external_events [req-de907fd1-b074-466d-aa92-505509d72a04 req-6da39f74-e8f2-45b5-8564-64f2db8c1357 service nova] Unable to find a host for instance bbc30a47-0cf1-4fae-b736-0f67761e2150. Dropping event network-vif-unplugged {{(pid=124104) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 16 16:51:50.631524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-de907fd1-b074-466d-aa92-505509d72a04 req-6da39f74-e8f2-45b5-8564-64f2db8c1357 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030251 Jun 16 16:51:50.632411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 653/1018] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 16 16:51:50.658811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8f4cfb31-cdd8-4732-bec3-c2c85d79bdfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:51:50.659665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8f4cfb31-cdd8-4732-bec3-c2c85d79bdfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:50.665739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f4cfb31-cdd8-4732-bec3-c2c85d79bdfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:50.666203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f4cfb31-cdd8-4732-bec3-c2c85d79bdfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:50.666988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f4cfb31-cdd8-4732-bec3-c2c85d79bdfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:50.667476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f4cfb31-cdd8-4732-bec3-c2c85d79bdfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:50.765739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8f4cfb31-cdd8-4732-bec3-c2c85d79bdfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "POST /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/action" status: 202 len: 0 microversion: 2.20 time: 0.110946 Jun 16 16:51:50.766532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 654/1019] 10.222.0.74 () {62 vars in 1318 bytes} [Thu Jun 16 16:51:50 2022] POST /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:51:50.774519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:50.775152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:50.781839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:50.781839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:50.782765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:50.782938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:50.921196 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:50.929705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:50.930746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:50.931959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-70ae5e54-169f-42f9-bb2d-dd9a98cffcd7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1672 microversion: 2.20 time: 0.161130 Jun 16 16:51:50.932479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 655/1020] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:50 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:51.954895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:51.956051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:51.967366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:51.967825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:51.968575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:51.968997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:52.112348 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:52.120624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:52.122129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:52.123392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d50c6184-559d-41b4-abbb-a182f13f4e60 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.175428 Jun 16 16:51:52.124002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 656/1021] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:51 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:53.148607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:53.149991 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:53.156809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:53.157369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:53.158390 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:53.159237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:53.311516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:53.320698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:53.322265 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:53.323562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-14a32cd0-e2d6-4ce3-a8eb-1c317572263e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.181301 Jun 16 16:51:53.324203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 657/1022] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:53 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:54.342705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:54.343488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:54.350336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:54.351038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:54.351827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:54.352243 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:54.498778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:54.507257 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:54.508739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:54.509899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d4caa43c-059a-4a61-8941-a1e267405682 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.171694 Jun 16 16:51:54.510454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 658/1023] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:54 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:55.531982 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:55.532662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:55.539783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:55.540546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:55.541413 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:55.542026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:55.683104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:55.691921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:55.693447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:55.694613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a747b8b0-ef7a-454b-abad-7c908255dcfe tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.168075 Jun 16 16:51:55.695188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 659/1024] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:55 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:51:56.714787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:56.715757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:56.722551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:56.722978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:56.723796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:56.724250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:56.871768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:56.881560 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:56.883096 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:56.884256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f1ab1e74-0f4b-473f-b670-6c347c014d5f tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.173436 Jun 16 16:51:56.884826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 660/1025] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:56 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:57.904247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:57.904888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:57.911425 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:57.911874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:57.912641 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:57.913082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:58.047449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:58.055691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:58.057512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:58.058706 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c31a8940-8ddd-4e3b-987f-9d0b5bc26ee1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.158674 Jun 16 16:51:58.059766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 661/1026] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:57 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:51:59.079167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:51:59.080969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:51:59.088316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:59.088859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:59.089622 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:51:59.090042 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:51:59.106334 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:51:59.241964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:59.250821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:59.252353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:51:59.253530 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-256217ef-d6c8-4275-a04e-d10a7a1f29fc tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.178899 Jun 16 16:51:59.254096 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 662/1027] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:51:59 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:00.273236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:00.273963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:00.280873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:00.281312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:00.282071 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:00.282496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:00.415951 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:00.424654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:00.426171 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:00.427481 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-64188a2d-5bf7-4465-ace0-bca994d01205 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.158161 Jun 16 16:52:00.428067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 663/1028] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:00 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:01.445913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:01.446631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:01.454668 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:01.455149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:01.455944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:01.456372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:01.597998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:01.606608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:01.608205 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:01.609388 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-82715a62-9afe-479c-bf65-2c133cbcd2e0 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.167547 Jun 16 16:52:01.611151 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 664/1029] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:01 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:02.628924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:02.629896 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:02.638482 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:02.639023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:02.639910 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:02.640471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:02.787763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:02.796962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:02.798500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:02.800077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1b133a0a-aae8-46f0-8408-0201478a4d50 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.175395 Jun 16 16:52:02.800833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 665/1030] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:02 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:03.820640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:03.821588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:03.830121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:03.830566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:03.831364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:03.831791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:03.979885 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:03.996662 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:03.999626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:04.000815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a4fd804a-f288-4695-bca4-96d7a054eca6 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.186679 Jun 16 16:52:04.001383 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 666/1031] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:03 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:05.024388 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:05.025097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:05.032366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:05.032809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:05.033566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:05.033992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:05.404937 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:05.416336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:05.418824 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:05.420964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-15873c6b-e056-45d6-9fd5-c5555a83fb09 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.400256 Jun 16 16:52:05.421825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 667/1032] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:05 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:52:06.443934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:06.445056 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:06.457421 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:06.457867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:06.458638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:06.459090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:06.614312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:06.627917 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:06.631013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:06.633142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-df395e3d-096e-4b23-a685-0215f4ae631d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.195627 Jun 16 16:52:06.634271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 668/1033] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:06 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:07.654457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:07.655296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:07.662118 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:07.662565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:07.663367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:07.663797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:07.810363 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:07.818848 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:07.820391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:07.821558 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6d0b4261-7a9a-41f4-be00-6fffefcd11cb tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.171391 Jun 16 16:52:07.822142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 669/1034] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:07 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:08.840895 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:08.841542 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:08.848744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:08.849194 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:08.849954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:08.850382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:08.992659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:09.002750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:09.004291 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:09.005462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f2d92094-4ced-4918-b22b-1f00d4796661 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.168685 Jun 16 16:52:09.006075 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 670/1035] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:08 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:10.031839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:10.032534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:10.039774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:10.040215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:10.040969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:10.041397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:10.183312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:10.194961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:10.197040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:10.198787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-687c08fd-586c-4cdd-8971-618ff5aa3a23 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.171558 Jun 16 16:52:10.199585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 671/1036] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:10 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:11.218984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:11.219775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:11.227903 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:11.228370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:11.229170 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:11.229738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:11.381318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:11.394370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:11.396763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:11.398647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-97cf406d-dbab-4c43-946c-bc73a8fab20e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.184571 Jun 16 16:52:11.399634 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 672/1037] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:11 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:12.424398 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:12.425048 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:12.431803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:12.432241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:12.432986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:12.433404 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:12.568101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:12.576367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:12.577845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:12.579001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ee7c8d58-f751-4bdb-b579-9c4f337fe946 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.158627 Jun 16 16:52:12.579602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 673/1038] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:12 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:13.599090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:13.599717 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:13.608272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:13.608777 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:13.609928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:13.610547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:13.767245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:13.775954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:13.777463 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:13.779353 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9d38a239-8ae1-49aa-8774-d65a4f2f287e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.184958 Jun 16 16:52:13.779927 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 674/1039] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:13 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:14.743440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-a41bf895-e72d-4fbe-b1a6-f39f86cb3e20 req-ccf7a6de-16c1-4ece-a60d-4d1dad28d0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc30a47-0cf1-4fae-b736-0f67761e2150", "name": "network-vif-plugged", "status": "completed", "tag": "3438f639-56b8-451a-81c9-c4ec1500cf56"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:52:14.752858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-a41bf895-e72d-4fbe-b1a6-f39f86cb3e20 req-ccf7a6de-16c1-4ece-a60d-4d1dad28d0d3 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:14.753335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-a41bf895-e72d-4fbe-b1a6-f39f86cb3e20 req-ccf7a6de-16c1-4ece-a60d-4d1dad28d0d3 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:14.764685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-a41bf895-e72d-4fbe-b1a6-f39f86cb3e20 req-ccf7a6de-16c1-4ece-a60d-4d1dad28d0d3 service nova] Creating event network-vif-plugged:3438f639-56b8-451a-81c9-c4ec1500cf56 for instance bbc30a47-0cf1-4fae-b736-0f67761e2150 on hv-cinder-83735 Jun 16 16:52:14.770228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-a41bf895-e72d-4fbe-b1a6-f39f86cb3e20 req-ccf7a6de-16c1-4ece-a60d-4d1dad28d0d3 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030662 Jun 16 16:52:14.770908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 675/1040] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:52:14.798079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:14.798795 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:14.805476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:14.805847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:14.806615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:14.807042 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:14.947551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:14.958121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:14.959663 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:14.960903 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-14d42620-28aa-4040-a8af-b46c74467546 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.167910 Jun 16 16:52:14.961493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 676/1041] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:14 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:15.981812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:15.982504 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:15.992790 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:15.993491 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:15.994391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:15.994843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:16.143176 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:16.155486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:16.157737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:16.159489 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-42d8c959-9d8a-4ed9-8709-7f26b433c72e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.183077 Jun 16 16:52:16.160331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 677/1042] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:15 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:17.183146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:17.183828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:17.191106 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:17.191499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:17.192282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:17.192694 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:17.335779 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:17.344868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:17.346376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:17.347640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cd0d48b7-ad28-4e1f-858c-ca7c39fb7e74 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1730 microversion: 2.20 time: 0.168490 Jun 16 16:52:17.348458 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 678/1043] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:17 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:52:18.366285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:18.366960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:18.369378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=64 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:52:18.374964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:18.375523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:18.376289 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:18.376712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:18.527335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:18.530511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:52:18.537841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:18.540165 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:52:18.541858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ce43ad23-bed6-4652-adf8-daf9d4600593 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1717 microversion: 2.20 time: 0.179505 Jun 16 16:52:18.542687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 679/1044] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:52:18 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1717 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:52:27.641722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e903d6b-31ee-4c6b-be7b-35b5aeeeb732", "name": "network-vif-deleted", "tag": "361eed59-d4cf-441b-9aea-4b05fcc698aa"}, {"server_uuid": "a54ec605-c392-472a-a282-72b1631a9f92", "name": "network-vif-deleted", "tag": "ec2a77a9-ab99-44ef-b4b5-4d131163de17"}, {"name": "network-changed", "server_uuid": "76def3bd-d733-4708-adad-1e7e7d17a584", "tag": "368dadc0-6d23-4b91-bc72-2b811bb87380"}, {"name": "network-changed", "server_uuid": "76def3bd-d733-4708-adad-1e7e7d17a584", "tag": "368dadc0-6d23-4b91-bc72-2b811bb87380"}, {"name": "network-changed", "server_uuid": "a73efd2c-4bd0-4f43-a720-aa81521289a8", "tag": "9802eee4-6c99-4fe8-9ec9-181124626a8a"}, {"name": "network-changed", "server_uuid": "a73efd2c-4bd0-4f43-a720-aa81521289a8", "tag": "9802eee4-6c99-4fe8-9ec9-181124626a8a"}, {"server_uuid": "0b7f89d4-2837-48f0-854e-4267acb270bb", "name": "network-vif-deleted", "tag": "6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d"}, {"name": "network-changed", "server_uuid": "bbc30a47-0cf1-4fae-b736-0f67761e2150", "tag": "3438f639-56b8-451a-81c9-c4ec1500cf56"}, {"server_uuid": "76def3bd-d733-4708-adad-1e7e7d17a584", "name": "network-vif-deleted", "tag": "368dadc0-6d23-4b91-bc72-2b811bb87380"}, {"server_uuid": "102aa75e-21d3-415e-9a04-d44e46ca9308", "name": "network-vif-deleted", "tag": "67748224-b4d4-4324-99dd-41ee8f120ef2"}, {"server_uuid": "8e74018d-237a-4638-972d-b5b85e487dc5", "name": "network-vif-deleted", "tag": "6c3cf76d-086d-4831-b63d-173afc22d303"}, {"server_uuid": "9f65e809-f39a-49b7-9749-16db6f08c895", "name": "network-vif-deleted", "tag": "31bdfc94-2e19-40b3-95f4-02cd2109b918"}, {"name": "network-changed", "server_uuid": "e76e921c-2e7d-4724-aea0-959173d115c6", "tag": "1b6f4fb1-8296-41be-95a6-2cb715710627"}, {"name": "network-changed", "server_uuid": "e76e921c-2e7d-4724-aea0-959173d115c6", "tag": "1b6f4fb1-8296-41be-95a6-2cb715710627"}, {"name": "network-changed", "server_uuid": "53a11b21-2cf2-45f9-9726-a3f7d7c191ae", "tag": "70531c65-24e2-4f59-8bac-070440cfec7e"}, {"server_uuid": "a73efd2c-4bd0-4f43-a720-aa81521289a8", "name": "network-vif-deleted", "tag": "9802eee4-6c99-4fe8-9ec9-181124626a8a"}, {"name": "network-changed", "server_uuid": "0595641e-4ce1-4716-90a3-8c279a0ee3a6", "tag": "25a60624-5ea4-4fa0-94ac-9ef3101ea1e7"}, {"name": "network-changed", "server_uuid": "0595641e-4ce1-4716-90a3-8c279a0ee3a6", "tag": "25a60624-5ea4-4fa0-94ac-9ef3101ea1e7"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:52:27.657877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:27.658314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:27.684370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:361eed59-d4cf-441b-9aea-4b05fcc698aa for instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 on hv-cinder-83735 Jun 16 16:52:27.684861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:ec2a77a9-ab99-44ef-b4b5-4d131163de17 for instance a54ec605-c392-472a-a282-72b1631a9f92 on hv-cinder-83735 Jun 16 16:52:27.685358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:368dadc0-6d23-4b91-bc72-2b811bb87380 for instance 76def3bd-d733-4708-adad-1e7e7d17a584 on hv-cinder-83735 Jun 16 16:52:27.685840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:368dadc0-6d23-4b91-bc72-2b811bb87380 for instance 76def3bd-d733-4708-adad-1e7e7d17a584 on hv-cinder-83735 Jun 16 16:52:27.686321 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:9802eee4-6c99-4fe8-9ec9-181124626a8a for instance a73efd2c-4bd0-4f43-a720-aa81521289a8 on hv-cinder-83735 Jun 16 16:52:27.686796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:9802eee4-6c99-4fe8-9ec9-181124626a8a for instance a73efd2c-4bd0-4f43-a720-aa81521289a8 on hv-cinder-83735 Jun 16 16:52:27.687307 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:6dc6cd69-9f4a-44ef-b1a3-8e08d273c75d for instance 0b7f89d4-2837-48f0-854e-4267acb270bb on hv-cinder-83735 Jun 16 16:52:27.687817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:3438f639-56b8-451a-81c9-c4ec1500cf56 for instance bbc30a47-0cf1-4fae-b736-0f67761e2150 on hv-cinder-83735 Jun 16 16:52:27.688294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:368dadc0-6d23-4b91-bc72-2b811bb87380 for instance 76def3bd-d733-4708-adad-1e7e7d17a584 on hv-cinder-83735 Jun 16 16:52:27.688771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:67748224-b4d4-4324-99dd-41ee8f120ef2 for instance 102aa75e-21d3-415e-9a04-d44e46ca9308 on hv-cinder-83735 Jun 16 16:52:27.689241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:6c3cf76d-086d-4831-b63d-173afc22d303 for instance 8e74018d-237a-4638-972d-b5b85e487dc5 on hv-cinder-83735 Jun 16 16:52:27.689712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:31bdfc94-2e19-40b3-95f4-02cd2109b918 for instance 9f65e809-f39a-49b7-9749-16db6f08c895 on hv-cinder-83735 Jun 16 16:52:27.690189 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:1b6f4fb1-8296-41be-95a6-2cb715710627 for instance e76e921c-2e7d-4724-aea0-959173d115c6 on hv-cinder-83735 Jun 16 16:52:27.690659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:1b6f4fb1-8296-41be-95a6-2cb715710627 for instance e76e921c-2e7d-4724-aea0-959173d115c6 on hv-cinder-83735 Jun 16 16:52:27.691139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:70531c65-24e2-4f59-8bac-070440cfec7e for instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae on hv-cinder-83735 Jun 16 16:52:27.691612 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-vif-deleted:9802eee4-6c99-4fe8-9ec9-181124626a8a for instance a73efd2c-4bd0-4f43-a720-aa81521289a8 on hv-cinder-83735 Jun 16 16:52:27.692089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:25a60624-5ea4-4fa0-94ac-9ef3101ea1e7 for instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 on hv-cinder-83735 Jun 16 16:52:27.692557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] Creating event network-changed:25a60624-5ea4-4fa0-94ac-9ef3101ea1e7 for instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 on hv-cinder-83735 Jun 16 16:52:27.714782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-9aee9c25-6f0c-4cc6-b103-d2aaee5ba09a req-82d59489-2988-4582-8147-2bb6218ef1af service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 3050 microversion: 2.1 time: 0.137022 Jun 16 16:52:27.715437 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 680/1045] 10.222.0.74 () {64 vars in 1318 bytes} [Thu Jun 16 16:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 3050 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:52:29.784508 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:52:29.785173 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:52:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:52:48.567083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:52:48.568126 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:52:48.572306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dfe944a0-8c74-420a-b6ef-e49acb0f3721 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:52:48.572877 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dfe944a0-8c74-420a-b6ef-e49acb0f3721 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:48.579961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfe944a0-8c74-420a-b6ef-e49acb0f3721 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:48.580398 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfe944a0-8c74-420a-b6ef-e49acb0f3721 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:48.581152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfe944a0-8c74-420a-b6ef-e49acb0f3721 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:48.581574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfe944a0-8c74-420a-b6ef-e49acb0f3721 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:48.608636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dfe944a0-8c74-420a-b6ef-e49acb0f3721 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/ips" status: 200 len: 143 microversion: 2.1 time: 0.043091 Jun 16 16:52:48.609290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 681/1046] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:52:48 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/ips => generated 143 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:52:52.204007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cea94db0-61a0-41c0-95dc-b792c746e38b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f3d58a5-9c81-44f1-9ed7-eae39976ce83"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:52:52.205083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cea94db0-61a0-41c0-95dc-b792c746e38b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:52:52.212445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cea94db0-61a0-41c0-95dc-b792c746e38b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:52.212888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cea94db0-61a0-41c0-95dc-b792c746e38b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:52.213650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cea94db0-61a0-41c0-95dc-b792c746e38b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:52:52.214084 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cea94db0-61a0-41c0-95dc-b792c746e38b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:52:52.496156 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cea94db0-61a0-41c0-95dc-b792c746e38b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.296242 Jun 16 16:52:52.496794 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 682/1047] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:52:52 2022] POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-volume_attachments => generated 194 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:01.113986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d4d5c3ae-ed19-4791-b3a0-1629835b24d9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:01.122787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4d5c3ae-ed19-4791-b3a0-1629835b24d9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:01.123292 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4d5c3ae-ed19-4791-b3a0-1629835b24d9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:01.186122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d4d5c3ae-ed19-4791-b3a0-1629835b24d9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Going to try to stop instance {{(pid=124104) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 16:53:01.236322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d4d5c3ae-ed19-4791-b3a0-1629835b24d9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action" status: 202 len: 0 microversion: 2.1 time: 0.126217 Jun 16 16:53:01.236994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 683/1048] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:53:01 2022] POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:53:01.246894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:01.247541 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:01.255016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:01.255590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:01.256381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:01.256848 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:01.423671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:01.432021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-797e0c8a-561b-44bd-8a8c-5b9898ae344e tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.189721 Jun 16 16:53:01.432594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 684/1049] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:01 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:02.455261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:02.455930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:02.463031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:02.463502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:02.464259 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:02.464666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:02.596940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:02.605629 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cef5f856-30fb-4cb3-b581-6aa5799a9367 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.154382 Jun 16 16:53:02.606207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 685/1050] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:02 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:03.628431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:03.629408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:03.637819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:03.638258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:03.639017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:03.639473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:03.778002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:03.786689 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-045b21dd-5f3b-470e-969c-50cf963b9573 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.165170 Jun 16 16:53:03.787295 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 686/1051] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:03 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:04.808809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:04.809604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:04.818315 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:04.818870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:04.819864 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:04.820404 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:04.966206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:04.978359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-55bcf079-d262-479a-a936-c52bf8e8c4e7 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.175868 Jun 16 16:53:04.978952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 687/1052] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:04 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:05.996201 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:05.997101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:06.004449 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:06.004893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:06.005669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:06.006086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:06.158563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:06.170111 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7de2cd4a-02f5-4a53-8815-396669cdd3d6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.177575 Jun 16 16:53:06.171004 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 688/1053] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:05 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:06.846326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-221773412", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-863924614", "security_groups": [{"name": "tempest-secgroup-smoke-2010524793"}], "block_device_mapping_v2": [{"uuid": "69181085-99fb-446c-a2fc-2a15a18a8677", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "58debe88-786d-44f3-b73a-fe19aa3ec834"}]}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:06.974092 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] validate_networks() for [('58debe88-786d-44f3-b73a-fe19aa3ec834', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:53:07.353751 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:53:07.354733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:53:07.355241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:53:07.355949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:53:07.356502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:53:07.365478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:07.365942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:07.366693 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:07.367142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:07.384109 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:53:07.388541 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Getting quotas for user d162fcafed2c4ae099a5786cceb84891 and project 256a9b5f5ad1405bb9fe21d591ef677d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:53:07.451086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:53:07.453208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69181085-99fb-446c-a2fc-2a15a18a8677',volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:53:07.605453 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d2a1ef3a-3667-4c55-ae21-4a5c5efd5124 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762568 Jun 16 16:53:07.606327 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 689/1054] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:53:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:53:07.613073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:07.613963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:07.623354 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:07.623797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:07.624569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:07.624978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:07.761886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:07.770808 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-22163169-977f-4a63-9374-f36b4e541b2f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.163147 Jun 16 16:53:07.771551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 690/1055] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:07 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:07.776135 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8397bc26-7f0e-4bc5-a209-989334dc60aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:07.776745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8397bc26-7f0e-4bc5-a209-989334dc60aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:07.832363 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8397bc26-7f0e-4bc5-a209-989334dc60aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:07.839022 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8397bc26-7f0e-4bc5-a209-989334dc60aa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1093 microversion: 2.1 time: 0.066544 Jun 16 16:53:07.839633 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 691/1056] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:07 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:07.855286 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:53:07.856196 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:53:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:53:08.790349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:08.791157 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:08.798959 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:08.799436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:08.800232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:08.800672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:08.943035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:08.951681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ea307bb2-96f6-4356-a010-cffdb2eb8c8b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.166314 Jun 16 16:53:08.952262 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 692/1057] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:08 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:08.956738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:08.957335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:08.963817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:08.964837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:08.965083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:08.965594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:09.027235 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:09.035452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-333a7445-1f88-4730-8371-dc157fe7adcb tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1209 microversion: 2.1 time: 0.082112 Jun 16 16:53:09.035974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 693/1058] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:08 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:09.968457 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:09.969132 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:09.977022 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:09.977460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:09.978241 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:09.978666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:10.122518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:10.132664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a136987e-f5be-417e-8424-31f7df5fbb66 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.168277 Jun 16 16:53:10.133359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 694/1059] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:09 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:10.139258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:10.140247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:10.147884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:10.148324 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:10.149083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:10.149502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:10.315133 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:10.323332 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bfba0fa1-818c-4847-a9d8-2831334c633c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.188577 Jun 16 16:53:10.324290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 695/1060] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:10 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:10.329534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-316ef742-de5e-4405-b90b-5c3c42fd5e5b req-f14318a9-b939-43d5-9af8-79272e476577 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec4ea5b-d19a-49d8-99d0-63a377e92780", "tag": "93acf8d3-b813-4157-9e5c-ed11b71411cb"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:10.338711 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-316ef742-de5e-4405-b90b-5c3c42fd5e5b req-f14318a9-b939-43d5-9af8-79272e476577 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:10.339182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-316ef742-de5e-4405-b90b-5c3c42fd5e5b req-f14318a9-b939-43d5-9af8-79272e476577 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:10.351960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-316ef742-de5e-4405-b90b-5c3c42fd5e5b req-f14318a9-b939-43d5-9af8-79272e476577 service nova] Creating event network-changed:93acf8d3-b813-4157-9e5c-ed11b71411cb for instance aec4ea5b-d19a-49d8-99d0-63a377e92780 on hv-cinder-83735 Jun 16 16:53:10.357095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-316ef742-de5e-4405-b90b-5c3c42fd5e5b req-f14318a9-b939-43d5-9af8-79272e476577 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031235 Jun 16 16:53:10.357711 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 696/1061] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:11.154716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:11.155461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:11.165001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:11.165532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:11.166675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:11.167245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:11.302186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:11.307773 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:11.315182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3a3d7947-e35a-4c68-997b-0ad8ac63e6a3 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1718 microversion: 2.1 time: 0.167734 Jun 16 16:53:11.315746 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 697/1062] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:11 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1718 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:11.341145 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:11.341758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:11.349386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:11.349822 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:11.350563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:11.350983 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:11.494583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:11.503412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-368268ba-23bc-42c4-8730-f2516b8979af tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.166038 Jun 16 16:53:11.503966 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 698/1063] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:11 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:12.337166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:12.344609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:12.349097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:12.349546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:12.350319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:12.350747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:12.485440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:12.493636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a082d436-8755-4cec-98f0-2183607d9405 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1695 microversion: 2.1 time: 0.160503 Jun 16 16:53:12.494285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 699/1064] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:12 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1695 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:12.510074 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5722e0e4-ed4a-4a0b-a4d9-c8be7ffab5d1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:12.517074 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5722e0e4-ed4a-4a0b-a4d9-c8be7ffab5d1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:12.517516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5722e0e4-ed4a-4a0b-a4d9-c8be7ffab5d1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:12.540930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5722e0e4-ed4a-4a0b-a4d9-c8be7ffab5d1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Going to try to start instance {{(pid=124104) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 16:53:12.588884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5722e0e4-ed4a-4a0b-a4d9-c8be7ffab5d1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action" status: 202 len: 0 microversion: 2.1 time: 0.081977 Jun 16 16:53:12.589760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 700/1065] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:53:12 2022] POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:53:12.597212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:12.597907 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:12.604696 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:12.605272 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:12.606563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:12.607187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:12.749603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:12.759236 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-341a7883-b6a5-4f30-84ec-689a4374a5d2 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.167124 Jun 16 16:53:12.759860 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 701/1066] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:12 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:12.764691 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:12.765298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:12.771695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:12.772137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:12.772897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:12.773319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:12.904418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:12.913123 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-65e3b4f6-fc3e-4f46-80bc-49218c0cb154 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1704 microversion: 2.1 time: 0.152312 Jun 16 16:53:12.913704 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 702/1067] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:12 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1704 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:13.776163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:13.776876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:13.784249 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:13.784700 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:13.785464 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:13.785894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:13.933075 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:13.944930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3275acb1-8e84-46d2-8b12-45f4afdd7095 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.172585 Jun 16 16:53:13.945757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 703/1068] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:13 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:13.952167 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:13.952775 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:13.958673 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:13.959156 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:13.959928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:13.960359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:14.115517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:14.129859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7291238a-4f66-4015-88d2-8a017b586f75 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1704 microversion: 2.1 time: 0.182615 Jun 16 16:53:14.130675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 704/1069] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:13 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1704 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:14.967663 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:14.968401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:14.977619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:14.978171 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:14.979415 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:14.979985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:15.128152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:15.135803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4db167bf-a09f-4ba9-bffe-9d51317c09a6 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.174311 Jun 16 16:53:15.136370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 705/1070] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:14 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:15.150707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:15.151439 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:15.157720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:15.158159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:15.158890 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:15.159355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:15.307311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:15.316267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ef12e886-7535-4b4d-a863-a5fe71e2dd76 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1708 microversion: 2.1 time: 0.169275 Jun 16 16:53:15.316875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 706/1071] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:15 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1708 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:16.152935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:16.154204 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:16.161280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:16.161724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:16.162475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:16.162908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:16.299537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:16.311805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-429bd262-aaf9-4c3e-9353-1d3f2e3de2bc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.162450 Jun 16 16:53:16.312657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 707/1072] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:16 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:17.334198 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:17.334899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:17.342244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:17.342688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:17.343481 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:17.343901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:17.374399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:17.490311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:17.500980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6b50788b-b620-4467-888c-7ba5805c31b0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.170966 Jun 16 16:53:17.501561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 708/1073] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:17 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:18.525124 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:18.526038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:18.530090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=8 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:18.540318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:18.541088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:18.542145 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:18.543193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:18.686342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:18.697263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9db102d8-22a1-4335-9755-b3b5838996c0 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.182409 Jun 16 16:53:18.698045 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 709/1074] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:18 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:19.714054 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:19.714722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:19.717120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:19.722809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:19.723284 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:19.724046 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:19.724472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:19.862246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:19.869843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d444d6e7-0166-4bc3-8721-1ea5afd0fef5 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.159749 Jun 16 16:53:19.870416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 710/1075] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:19 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:20.891174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:20.892210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:20.903102 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:20.903861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:20.904889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:20.905393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:21.053935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:21.064565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2732ea86-7c57-4241-80e1-51b3a97979dc tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.179869 Jun 16 16:53:21.065362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 711/1076] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:20 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:22.081695 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:22.082416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:22.089301 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:22.089782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:22.090522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:22.090951 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:22.224555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:22.232387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fcee62b4-a329-44aa-86fa-35bd600d187c tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.154447 Jun 16 16:53:22.233111 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 712/1077] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:22 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:23.249943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:23.250638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:23.257739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:23.258195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:23.258961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:23.259592 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:23.282442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:23.404851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:23.412852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2b34125c-b3a3-490f-9c28-ef70051fa9bf tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.167180 Jun 16 16:53:23.413433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 713/1078] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:23 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:23.417928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-a8ee3d4a-eb34-420b-bd4b-811f8644864e req-d379f977-491c-48fc-a155-43b3fccb68dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec4ea5b-d19a-49d8-99d0-63a377e92780", "name": "network-vif-plugged", "status": "completed", "tag": "93acf8d3-b813-4157-9e5c-ed11b71411cb"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:23.425992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-a8ee3d4a-eb34-420b-bd4b-811f8644864e req-d379f977-491c-48fc-a155-43b3fccb68dc service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:23.426436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-a8ee3d4a-eb34-420b-bd4b-811f8644864e req-d379f977-491c-48fc-a155-43b3fccb68dc service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:23.437602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-a8ee3d4a-eb34-420b-bd4b-811f8644864e req-d379f977-491c-48fc-a155-43b3fccb68dc service nova] Creating event network-vif-plugged:93acf8d3-b813-4157-9e5c-ed11b71411cb for instance aec4ea5b-d19a-49d8-99d0-63a377e92780 on hv-cinder-83735 Jun 16 16:53:23.442718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-a8ee3d4a-eb34-420b-bd4b-811f8644864e req-d379f977-491c-48fc-a155-43b3fccb68dc service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028192 Jun 16 16:53:23.443507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 714/1079] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:24.436868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:24.438003 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:24.448734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:24.449466 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:24.451611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:24.451756 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:24.604057 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:24.611857 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1da6538d-668f-41dc-b2c0-3c8ecee4309e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.183777 Jun 16 16:53:24.612433 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 715/1080] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:24 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:25.633147 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:25.634183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:25.645826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:25.646578 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:25.647882 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:25.648602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:25.789104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:25.798771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3f3baac1-0d2e-4a71-a3f8-535964ee4151 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1265 microversion: 2.1 time: 0.172137 Jun 16 16:53:25.799450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 716/1081] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:25 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:26.824783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:26.825928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:26.833812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:26.834264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:26.835020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:26.835477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:26.977386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:26.989748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9af991c2-3c1e-4697-8700-2cf441abfe7e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1451 microversion: 2.1 time: 0.170867 Jun 16 16:53:26.990539 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 717/1082] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:26 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:26.997411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4eb8896c-1ff7-4863-ba76-7dc8bc2f2225 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:26.998227 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4eb8896c-1ff7-4863-ba76-7dc8bc2f2225 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:27.003762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb8896c-1ff7-4863-ba76-7dc8bc2f2225 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:27.004197 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb8896c-1ff7-4863-ba76-7dc8bc2f2225 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:27.004946 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb8896c-1ff7-4863-ba76-7dc8bc2f2225 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:27.005369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4eb8896c-1ff7-4863-ba76-7dc8bc2f2225 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:27.029108 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4eb8896c-1ff7-4863-ba76-7dc8bc2f2225 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/ips" status: 200 len: 149 microversion: 2.1 time: 0.037337 Jun 16 16:53:27.029666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 718/1083] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:53:26 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:27.033925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:27.034516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:27.040356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:27.040813 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:27.041534 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:27.041956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:27.174238 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:27.182081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bbd8ee5d-2c35-4cf1-b011-cae44d52611b tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1451 microversion: 2.1 time: 0.151443 Jun 16 16:53:27.182697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 719/1084] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:27 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:28.355573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9dfd1ffa-c7e5-4a20-903e-95c74cad43ce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53a05cfc-60e4-41c9-ba3c-d6b9a72118a6"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:28.356685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9dfd1ffa-c7e5-4a20-903e-95c74cad43ce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:28.364234 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ffa-c7e5-4a20-903e-95c74cad43ce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:28.364678 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ffa-c7e5-4a20-903e-95c74cad43ce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:28.365439 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ffa-c7e5-4a20-903e-95c74cad43ce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:28.365868 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ffa-c7e5-4a20-903e-95c74cad43ce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:28.658425 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9dfd1ffa-c7e5-4a20-903e-95c74cad43ce tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "POST /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306859 Jun 16 16:53:28.659399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 720/1085] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:53:28 2022] POST /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:53:29.110460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-4ea7ba1d-40b0-4d52-b358-aa1f7e4d3de4 req-efb1a4b6-907d-46d5-b807-89e2f15399d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec4ea5b-d19a-49d8-99d0-63a377e92780", "tag": "93acf8d3-b813-4157-9e5c-ed11b71411cb"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:29.118858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-4ea7ba1d-40b0-4d52-b358-aa1f7e4d3de4 req-efb1a4b6-907d-46d5-b807-89e2f15399d0 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:29.119333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-4ea7ba1d-40b0-4d52-b358-aa1f7e4d3de4 req-efb1a4b6-907d-46d5-b807-89e2f15399d0 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:29.133001 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-4ea7ba1d-40b0-4d52-b358-aa1f7e4d3de4 req-efb1a4b6-907d-46d5-b807-89e2f15399d0 service nova] Creating event network-changed:93acf8d3-b813-4157-9e5c-ed11b71411cb for instance aec4ea5b-d19a-49d8-99d0-63a377e92780 on hv-cinder-83735 Jun 16 16:53:29.137835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-4ea7ba1d-40b0-4d52-b358-aa1f7e4d3de4 req-efb1a4b6-907d-46d5-b807-89e2f15399d0 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096471 Jun 16 16:53:29.139147 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 721/1086] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:53:37.386669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:37.387306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:37.394182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:37.394631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:37.395423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:37.395879 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:37.480587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lazy-loading 'services' on Instance uuid 0595641e-4ce1-4716-90a3-8c279a0ee3a6 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:53:37.564452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-60d37775-6847-47c7-9dfc-03d4ff8043ed tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments/53a05cfc-60e4-41c9-ba3c-d6b9a72118a6" status: 202 len: 0 microversion: 2.1 time: 0.183193 Jun 16 16:53:37.565142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 722/1087] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:53:37 2022] DELETE /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments/53a05cfc-60e4-41c9-ba3c-d6b9a72118a6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:53:37.573830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c36f86e1-151a-43b5-be8d-59f10a561258 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:37.574893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c36f86e1-151a-43b5-be8d-59f10a561258 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:37.581938 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c36f86e1-151a-43b5-be8d-59f10a561258 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:37.582390 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c36f86e1-151a-43b5-be8d-59f10a561258 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:37.583452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c36f86e1-151a-43b5-be8d-59f10a561258 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:37.583949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c36f86e1-151a-43b5-be8d-59f10a561258 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:37.614405 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c36f86e1-151a-43b5-be8d-59f10a561258 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Jun 16 16:53:37.614973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 723/1088] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:53:37 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:38.626095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-326184ca-5be7-4647-891c-9408aaadcbbc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:38.627847 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-326184ca-5be7-4647-891c-9408aaadcbbc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:38.635698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326184ca-5be7-4647-891c-9408aaadcbbc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:38.636136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326184ca-5be7-4647-891c-9408aaadcbbc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:38.637037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326184ca-5be7-4647-891c-9408aaadcbbc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:38.637474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-326184ca-5be7-4647-891c-9408aaadcbbc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:38.671002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-326184ca-5be7-4647-891c-9408aaadcbbc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048986 Jun 16 16:53:38.671767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 724/1089] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:53:38 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:39.684989 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b9e01698-0b1e-43c0-8e94-a69283b3dc91 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:39.685863 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b9e01698-0b1e-43c0-8e94-a69283b3dc91 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:39.693496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9e01698-0b1e-43c0-8e94-a69283b3dc91 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:39.693942 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9e01698-0b1e-43c0-8e94-a69283b3dc91 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:39.694752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9e01698-0b1e-43c0-8e94-a69283b3dc91 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:39.695245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b9e01698-0b1e-43c0-8e94-a69283b3dc91 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:39.730407 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b9e01698-0b1e-43c0-8e94-a69283b3dc91 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051301 Jun 16 16:53:39.730961 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 725/1090] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:53:39 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:53:39.790104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:39.790599 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:39.797116 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:39.797569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:39.798323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:39.798757 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:39.824150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:53:39.905445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dd781be1-1e62-4fc6-ab02-14212620f1ac tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 204 len: 0 microversion: 2.1 time: 0.118755 Jun 16 16:53:39.906258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 726/1091] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:53:39 2022] DELETE /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:53:39.915587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:39.916271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:39.923997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:39.924588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:39.925555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:39.925972 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:40.057554 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:40.065381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5a8d784e-8495-4e51-a621-53fe13a286ee tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1679 microversion: 2.1 time: 0.153982 Jun 16 16:53:40.065951 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 727/1092] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:39 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:41.083090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:41.083819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:41.092171 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:41.092760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:41.093925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:41.094519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:41.100264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:41.240152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:41.247812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-714f4a97-8b20-41a9-91a2-a94e949b37bc tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1679 microversion: 2.1 time: 0.169103 Jun 16 16:53:41.248386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 728/1093] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:41 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:42.265867 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:42.266655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:42.274072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:42.274837 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:42.276110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:42.276685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:42.429597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:42.437485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-83385b06-b726-4685-80be-3555bd80cde5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1679 microversion: 2.1 time: 0.176088 Jun 16 16:53:42.438058 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 729/1094] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:42 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:43.462253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:43.462936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:43.469782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.470223 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.470977 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.471422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.535845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:43.548185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-07a5127a-2769-4752-88b2-4c0f012f5bb5 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1612 microversion: 2.1 time: 0.091756 Jun 16 16:53:43.556088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 730/1095] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:43 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1612 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:43.562754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-d411008c-4775-4a8e-8c30-8fea31ec1f77 req-a7593403-96d2-47cb-80e5-cb044a2898ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0595641e-4ce1-4716-90a3-8c279a0ee3a6", "name": "network-vif-deleted", "tag": "25a60624-5ea4-4fa0-94ac-9ef3101ea1e7"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:43.577330 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-d411008c-4775-4a8e-8c30-8fea31ec1f77 req-a7593403-96d2-47cb-80e5-cb044a2898ba service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.577783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-d411008c-4775-4a8e-8c30-8fea31ec1f77 req-a7593403-96d2-47cb-80e5-cb044a2898ba service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.604623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-d411008c-4775-4a8e-8c30-8fea31ec1f77 req-a7593403-96d2-47cb-80e5-cb044a2898ba service nova] Creating event network-vif-deleted:25a60624-5ea4-4fa0-94ac-9ef3101ea1e7 for instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 on hv-cinder-83735 Jun 16 16:53:43.610188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-d411008c-4775-4a8e-8c30-8fea31ec1f77 req-a7593403-96d2-47cb-80e5-cb044a2898ba service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052625 Jun 16 16:53:43.610919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 731/1096] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:43.689070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-07233fce-2265-42c9-9d81-ffac43949866 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:43.690038 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-07233fce-2265-42c9-9d81-ffac43949866 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:43.696763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07233fce-2265-42c9-9d81-ffac43949866 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.697245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07233fce-2265-42c9-9d81-ffac43949866 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.698034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07233fce-2265-42c9-9d81-ffac43949866 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.698467 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-07233fce-2265-42c9-9d81-ffac43949866 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.740310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-07233fce-2265-42c9-9d81-ffac43949866 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.063413 Jun 16 16:53:43.741286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 732/1097] 10.222.0.74 () {60 vars in 1342 bytes} [Thu Jun 16 16:53:43 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:53:43.810357 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:43.810894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:43.817210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.817621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.818386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.818845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.844282 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:53:43.925714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-957dbfd5-1708-4468-beda-81f5388b9de2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 204 len: 0 microversion: 2.20 time: 0.120423 Jun 16 16:53:43.926316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 733/1098] 10.222.0.74 () {60 vars in 1279 bytes} [Thu Jun 16 16:53:43 2022] DELETE /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 16 16:53:43.935908 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:43.936651 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:43.944083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.944497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:43.945216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:43.945637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:44.101765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:44.110209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:44.111819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:44.112970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d2312817-5578-4af3-a4dc-5e330fbfeddf tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.181746 Jun 16 16:53:44.113811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 734/1099] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:53:43 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:53:44.566036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:44.566645 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:44.573619 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:44.574064 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:44.574948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:44.575412 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:44.606335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:44.606770 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:44.607237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lazy-loading 'fault' on Instance uuid 0595641e-4ce1-4716-90a3-8c279a0ee3a6 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:53:44.649586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b49313559188427bb9f42068583a8292', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8725edcf74cc463cafe3614a3bd880e6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:44.657679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f497ba86-22ac-4904-b327-a3c2bd23b930 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 200 len: 1330 microversion: 2.1 time: 0.095539 Jun 16 16:53:44.658255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 735/1100] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:44 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:53:45.136681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:45.137638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:45.148450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:45.149199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:45.150486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:45.151244 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:45.297024 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:45.310149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:45.311749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:45.312936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a49b8ff0-0a60-4182-9d4c-f9f9e7358915 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.183235 Jun 16 16:53:45.313701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 736/1101] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:53:45 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:53:45.679615 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:45.680298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:45.687970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:45.688410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:45.689179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:45.689579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:45.704809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 HTTP/1.1 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0595641e-4ce1-4716-90a3-8c279a0ee3a6'} Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:45.707129 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e7c02f95-517d-4793-8efd-8efa59757103 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 404 len: 111 microversion: 2.1 time: 0.033117 Jun 16 16:53:45.711738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 737/1102] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:45 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:45.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-df4c8dd2-545e-4630-a3b4-5a363d59ca02 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '.version_select at 0x7fe5f8b3a820>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:45.737899 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-df4c8dd2-545e-4630-a3b4-5a363d59ca02 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-293494010" status: 202 len: 0 microversion: 2.1 time: 0.024162 Jun 16 16:53:45.738490 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 738/1103] 10.222.0.74 () {58 vars in 1217 bytes} [Thu Jun 16 16:53:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-293494010 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:53:46.334478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:46.335107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:46.342970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:46.343414 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:46.344177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:46.344818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:46.480995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:46.489855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:46.491419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:46.492616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4e7b7f52-5351-4b7e-a92b-b1a14443da66 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1723 microversion: 2.20 time: 0.162286 Jun 16 16:53:46.493179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 739/1104] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:53:46 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 16 16:53:47.355883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-58b30b71-3b07-4e53-96b9-e15ccfce65e4 req-5bde889c-2d6a-4bfe-8be4-8e64724a4463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbc30a47-0cf1-4fae-b736-0f67761e2150", "name": "network-vif-deleted", "tag": "3438f639-56b8-451a-81c9-c4ec1500cf56"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:47.366810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-58b30b71-3b07-4e53-96b9-e15ccfce65e4 req-5bde889c-2d6a-4bfe-8be4-8e64724a4463 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.367670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-58b30b71-3b07-4e53-96b9-e15ccfce65e4 req-5bde889c-2d6a-4bfe-8be4-8e64724a4463 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.380161 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-58b30b71-3b07-4e53-96b9-e15ccfce65e4 req-5bde889c-2d6a-4bfe-8be4-8e64724a4463 service nova] Creating event network-vif-deleted:3438f639-56b8-451a-81c9-c4ec1500cf56 for instance bbc30a47-0cf1-4fae-b736-0f67761e2150 on hv-cinder-83735 Jun 16 16:53:47.385372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-58b30b71-3b07-4e53-96b9-e15ccfce65e4 req-5bde889c-2d6a-4bfe-8be4-8e64724a4463 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033173 Jun 16 16:53:47.386073 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 740/1105] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:53:47.511709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:47.512551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:47.522181 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.524562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.525722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.526497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.583832 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.584408 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.584923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lazy-loading 'fault' on Instance uuid bbc30a47-0cf1-4fae-b736-0f67761e2150 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:53:47.866468 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:47.877016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:47.880180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80113e82c4a74f4e8fd42b88aca3920d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '627133a3363742fda58273b067fab968', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:53:47.881886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d606e4c0-7ba4-4dac-a83a-6a9ceafde1e7 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 200 len: 1371 microversion: 2.20 time: 0.374141 Jun 16 16:53:47.883275 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 741/1106] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:53:47 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 1371 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 16 16:53:47.887544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:47.888101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:47.894796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.895271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.896035 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.896458 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.910887 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 HTTP/1.1 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0595641e-4ce1-4716-90a3-8c279a0ee3a6'} Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:47.912609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b2edffc8-88d7-4836-b9c8-464937eed81c tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 404 len: 111 microversion: 2.1 time: 0.030005 Jun 16 16:53:47.918255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 742/1107] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:53:47 2022] DELETE /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:47.923896 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:47.924614 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0595641e-4ce1-4716-90a3-8c279a0ee3a6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:47.930954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.931439 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.932208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:47.932631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:47.947434 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 HTTP/1.1 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0595641e-4ce1-4716-90a3-8c279a0ee3a6'} Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:47.949016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance 0595641e-4ce1-4716-90a3-8c279a0ee3a6 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-caf05410-70c1-4c3d-a54a-477aca56ac11 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6" status: 404 len: 111 microversion: 2.1 time: 0.030560 Jun 16 16:53:47.953964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 743/1108] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:47 2022] GET /compute/v2.1/servers/0595641e-4ce1-4716-90a3-8c279a0ee3a6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:48.903762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:48.904438 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:48.911759 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:48.912202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:48.912966 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:48.913397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:48.927968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] HTTP exception thrown: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Request method failure captured: Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 HTTP/1.1 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MPfRph0ckii1mOZNGy2sSQ_w87mnVX-vhGnFbwbZrMqVzjhzDJlo2YqIozCUf_KfI2MSFMYm_vhrEnduqBLExGo_DlLZGDmHwHG221IOXPco7uxl12gRPbWjYiAjpxBOQpqmzUeXTIvfzF8WKM6d_Q3xGX5nP0bQwaG9RZoRPAYg Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/627133a3363742fda58273b067fab968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_627133a3363742fda58273b067fab968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 80113e82c4a74f4e8fd42b88aca3920d Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'bbc30a47-0cf1-4fae-b736-0f67761e2150'} Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:48.929499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Returning 404 to user: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5931876c-377c-4f36-974c-8360275e4f98 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 404 len: 111 microversion: 2.20 time: 0.031454 Jun 16 16:53:48.933749 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 744/1109] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:53:48 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:53:48.940575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1ea2b1c1-543f-40b0-84e3-2906c168619a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '.version_select at 0x7fe5fd2db670>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:48.962891 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1ea2b1c1-543f-40b0-84e3-2906c168619a tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-429904795" status: 204 len: 0 microversion: 2.20 time: 0.025662 Jun 16 16:53:48.963839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 745/1110] 10.222.0.74 () {60 vars in 1258 bytes} [Thu Jun 16 16:53:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-429904795 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 16 16:53:49.096609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:49.097101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:49.103367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.103811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.104572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.105002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.119174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 HTTP/1.1 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'a73efd2c-4bd0-4f43-a720-aa81521289a8'} Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:49.120754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5ef687d3-fe0f-4490-9749-01ae0ef72881 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 404 len: 111 microversion: 2.1 time: 0.029797 Jun 16 16:53:49.130593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 746/1111] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:53:49 2022] DELETE /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:49.132820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:49.132820 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a73efd2c-4bd0-4f43-a720-aa81521289a8] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:49.138296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.138732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.139852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.140279 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.154614 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 HTTP/1.1 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'a73efd2c-4bd0-4f43-a720-aa81521289a8'} Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.156616 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance a73efd2c-4bd0-4f43-a720-aa81521289a8 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7f2910cc-92b1-46a3-bae8-568d879ef5a1 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8" status: 404 len: 111 microversion: 2.1 time: 0.031178 Jun 16 16:53:49.165609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 747/1112] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:49 2022] GET /compute/v2.1/servers/a73efd2c-4bd0-4f43-a720-aa81521289a8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:49.175664 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:49.176712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:49.182799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.183276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.184067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.184807 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.203949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 HTTP/1.1 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0e903d6b-31ee-4c6b-be7b-35b5aeeeb732'} Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:49.205523 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3fa92f7f-cf4a-4975-9937-cba5605b3350 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 404 len: 111 microversion: 2.1 time: 0.035089 Jun 16 16:53:49.210791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 748/1113] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:53:49 2022] DELETE /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:49.218242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:49.218939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:49.225014 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.225550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.226388 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:49.226818 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:49.241055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 HTTP/1.1 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0e903d6b-31ee-4c6b-be7b-35b5aeeeb732'} Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:49.242581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance 0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-39859a37-a273-4822-b548-94872f121891 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732" status: 404 len: 111 microversion: 2.1 time: 0.031026 Jun 16 16:53:49.246984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 749/1114] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:49 2022] GET /compute/v2.1/servers/0e903d6b-31ee-4c6b-be7b-35b5aeeeb732 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:50.399190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:50.399913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:50.402399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:50.408136 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.408579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.409338 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.409766 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.424892 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 HTTP/1.1 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'a54ec605-c392-472a-a282-72b1631a9f92'} Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:50.426471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-603ccca4-45bd-4b92-9893-556c164dcdb8 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "DELETE /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 404 len: 111 microversion: 2.1 time: 0.033049 Jun 16 16:53:50.430901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 750/1115] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:53:50 2022] DELETE /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:50.436314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:50.436921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] [instance: a54ec605-c392-472a-a282-72b1631a9f92] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:50.443416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.443960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.444621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.445065 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.458976 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] HTTP exception thrown: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Request method failure captured: Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 HTTP/1.1 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10JurrvEVuR7m6Cd6vOHbcnqtxgqXWxs4bJDcOuTfmZevlE661cRX_76-NqF_jJRBGx-qkmHUYd1uH8SLEyGDp_uBWdtf5DIqbWQI7Fphafftne8LhmvMcqEfSEAmVOhOylcohs31uhsKJTLYvYgHkZFSApM_VIIYSAK5Vh6PPdBpw Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_8725edcf74cc463cafe3614a3bd880e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 8725edcf74cc463cafe3614a3bd880e6 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-819177178 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: b49313559188427bb9f42068583a8292 Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeNegativeTest-819177178-project Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'a54ec605-c392-472a-a282-72b1631a9f92'} Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.460518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] Returning 404 to user: Instance a54ec605-c392-472a-a282-72b1631a9f92 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-34d766f4-2f76-4dde-80c3-81dcf398cff6 tempest-AttachVolumeNegativeTest-819177178 tempest-AttachVolumeNegativeTest-819177178-project] 10.222.0.74 "GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92" status: 404 len: 111 microversion: 2.1 time: 0.029336 Jun 16 16:53:50.464833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 751/1116] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:53:50 2022] GET /compute/v2.1/servers/a54ec605-c392-472a-a282-72b1631a9f92 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:53:50.769791 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:50.770384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:50.776709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.777229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.778081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.778702 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.792647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] HTTP exception thrown: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Request method failure captured: Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 HTTP/1.1 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MPfRph0ckii1mOZNGy2sSQ_w87mnVX-vhGnFbwbZrMqVzjhzDJlo2YqIozCUf_KfI2MSFMYm_vhrEnduqBLExGo_DlLZGDmHwHG221IOXPco7uxl12gRPbWjYiAjpxBOQpqmzUeXTIvfzF8WKM6d_Q3xGX5nP0bQwaG9RZoRPAYg Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/627133a3363742fda58273b067fab968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_627133a3363742fda58273b067fab968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 80113e82c4a74f4e8fd42b88aca3920d Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'bbc30a47-0cf1-4fae-b736-0f67761e2150'} Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:50.794665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Returning 404 to user: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1e8daf04-f615-48cc-8a6b-4ad23e299ae1 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 404 len: 111 microversion: 2.20 time: 0.030220 Jun 16 16:53:50.799440 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 752/1117] 10.222.0.74 () {60 vars in 1279 bytes} [Thu Jun 16 16:53:50 2022] DELETE /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:53:50.808873 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:50.809562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: bbc30a47-0cf1-4fae-b736-0f67761e2150] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:50.816209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.816643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.817399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:50.817822 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:50.821998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:53:50.833743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] HTTP exception thrown: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Request method failure captured: Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 HTTP/1.1 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MPfRph0ckii1mOZNGy2sSQ_w87mnVX-vhGnFbwbZrMqVzjhzDJlo2YqIozCUf_KfI2MSFMYm_vhrEnduqBLExGo_DlLZGDmHwHG221IOXPco7uxl12gRPbWjYiAjpxBOQpqmzUeXTIvfzF8WKM6d_Q3xGX5nP0bQwaG9RZoRPAYg Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/627133a3363742fda58273b067fab968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_627133a3363742fda58273b067fab968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 80113e82c4a74f4e8fd42b88aca3920d Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'bbc30a47-0cf1-4fae-b736-0f67761e2150'} Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.835550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Returning 404 to user: Instance bbc30a47-0cf1-4fae-b736-0f67761e2150 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0067e8ad-9f77-4426-a579-49a042b85d1d tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150" status: 404 len: 111 microversion: 2.20 time: 0.031898 Jun 16 16:53:50.843043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 753/1118] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:53:50 2022] GET /compute/v2.1/servers/bbc30a47-0cf1-4fae-b736-0f67761e2150 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:53:51.984267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:51.985069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:51.992955 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:51.993379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:51.994142 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:51.994571 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:52.009263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] HTTP exception thrown: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Request method failure captured: Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb HTTP/1.1 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MPfRph0ckii1mOZNGy2sSQ_w87mnVX-vhGnFbwbZrMqVzjhzDJlo2YqIozCUf_KfI2MSFMYm_vhrEnduqBLExGo_DlLZGDmHwHG221IOXPco7uxl12gRPbWjYiAjpxBOQpqmzUeXTIvfzF8WKM6d_Q3xGX5nP0bQwaG9RZoRPAYg Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/627133a3363742fda58273b067fab968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_627133a3363742fda58273b067fab968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 80113e82c4a74f4e8fd42b88aca3920d Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0b7f89d4-2837-48f0-854e-4267acb270bb'} Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:52.010909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Returning 404 to user: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-36e77987-c8e0-4da3-b3f7-0a333d1aff8e tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "DELETE /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 404 len: 111 microversion: 2.20 time: 0.032979 Jun 16 16:53:52.016306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 754/1119] 10.222.0.74 () {60 vars in 1279 bytes} [Thu Jun 16 16:53:51 2022] DELETE /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:53:52.021772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:52.022378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] [instance: 0b7f89d4-2837-48f0-854e-4267acb270bb] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:53:52.029637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:52.029637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:52.029637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:53:52.030061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:53:52.044130 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] HTTP exception thrown: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Request method failure captured: Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb HTTP/1.1 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq10MPfRph0ckii1mOZNGy2sSQ_w87mnVX-vhGnFbwbZrMqVzjhzDJlo2YqIozCUf_KfI2MSFMYm_vhrEnduqBLExGo_DlLZGDmHwHG221IOXPco7uxl12gRPbWjYiAjpxBOQpqmzUeXTIvfzF8WKM6d_Q3xGX5nP0bQwaG9RZoRPAYg Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Openstack-Nova-Api-Version: 2.20 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/627133a3363742fda58273b067fab968"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/627133a3363742fda58273b067fab968"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_627133a3363742fda58273b067fab968"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 627133a3363742fda58273b067fab968 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1189060709 Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 80113e82c4a74f4e8fd42b88aca3920d Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1189060709-project Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '0b7f89d4-2837-48f0-854e-4267acb270bb'} Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.045728 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] Returning 404 to user: Instance 0b7f89d4-2837-48f0-854e-4267acb270bb could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-42708168-8835-430d-9034-30bdf55d8cc2 tempest-AttachVolumeShelveTestJSON-1189060709 tempest-AttachVolumeShelveTestJSON-1189060709-project] 10.222.0.74 "GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb" status: 404 len: 111 microversion: 2.20 time: 0.029093 Jun 16 16:53:52.050586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 755/1120] 10.222.0.74 () {60 vars in 1276 bytes} [Thu Jun 16 16:53:52 2022] GET /compute/v2.1/servers/0b7f89d4-2837-48f0-854e-4267acb270bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:53:57.686921 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-76851a1c-edbf-43e5-a29f-78adb90dc3ac tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Action: 'create', calling method: .version_select at 0x7fe5f8be11f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1662124744", "metadata": {"Type": "work"}}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-76851a1c-edbf-43e5-a29f-78adb90dc3ac tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Request method failure captured: Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 122 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2AlnJnPtRyEqDlt1-8fMhtIHQc6OblfzDWZ_H1qCGPUSDnRrDDjKyFppkp9xWU5feLIY-3NKqb2QYUIxhBDzmH4XGcnNvEZz1uexdmWxRJihaT9ucC1mOa0j4LnrcOO0ZVGW3pPf4Y2at2VBTgZrDDiIOdQJ1zaNcC4NGyes7fx9X0 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_865f6562c3704721aff6b41b28d075d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab61dd4bdcd4fbca82887335b237707 Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1662124744", "metadata": {"Type": "work"}}} Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1662124744', 'metadata': {'Type': 'work'}}}} Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi '#$%' Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:53:57.703229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-76851a1c-edbf-43e5-a29f-78adb90dc3ac tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-76851a1c-edbf-43e5-a29f-78adb90dc3ac tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143123 Jun 16 16:53:57.708396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 756/1121] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Jun 16 16:53:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:53:57.714992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-127de129-173d-4a3a-adf2-07e200b633bc tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Action: 'create', calling method: .version_select at 0x7fe5fd23b280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1125101197", "metadata": {"Type": "work"}}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-127de129-173d-4a3a-adf2-07e200b633bc tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Request method failure captured: Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 120 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2AlnJnPtRyEqDlt1-8fMhtIHQc6OblfzDWZ_H1qCGPUSDnRrDDjKyFppkp9xWU5feLIY-3NKqb2QYUIxhBDzmH4XGcnNvEZz1uexdmWxRJihaT9ucC1mOa0j4LnrcOO0ZVGW3pPf4Y2at2VBTgZrDDiIOdQJ1zaNcC4NGyes7fx9X0 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_865f6562c3704721aff6b41b28d075d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab61dd4bdcd4fbca82887335b237707 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1125101197", "metadata": {"Type": "work"}}} Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1125101197', 'metadata': {'Type': 'work'}}}} Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi '0' Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:53:57.717377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-127de129-173d-4a3a-adf2-07e200b633bc tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-127de129-173d-4a3a-adf2-07e200b633bc tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007440 Jun 16 16:53:57.722509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 757/1122] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Jun 16 16:53:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 16 16:53:57.728985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-804a7e14-a529-492e-8543-1defe64f61e2 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Action: 'create', calling method: .version_select at 0x7fe5f8b3aa60>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1699414341", "metadata": {"Type": "work"}}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-804a7e14-a529-492e-8543-1defe64f61e2 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Request method failure captured: Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 119 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2AlnJnPtRyEqDlt1-8fMhtIHQc6OblfzDWZ_H1qCGPUSDnRrDDjKyFppkp9xWU5feLIY-3NKqb2QYUIxhBDzmH4XGcnNvEZz1uexdmWxRJihaT9ucC1mOa0j4LnrcOO0ZVGW3pPf4Y2at2VBTgZrDDiIOdQJ1zaNcC4NGyes7fx9X0 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_865f6562c3704721aff6b41b28d075d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab61dd4bdcd4fbca82887335b237707 Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1699414341", "metadata": {"Type": "work"}}} Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1699414341', 'metadata': {'Type': 'work'}}}} Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise error Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi '' Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 16 16:53:57.731517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-804a7e14-a529-492e-8543-1defe64f61e2 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-804a7e14-a529-492e-8543-1defe64f61e2 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008286 Jun 16 16:53:57.736462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 758/1123] 10.222.0.74 () {60 vars in 1155 bytes} [Thu Jun 16 16:53:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 16 16:53:57.742186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d9f397cb-52f9-45b5-a1dc-887bb7c022c9 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Calling method '.version_select at 0x7fe5fd34bee0>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:57.770503 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-d9f397cb-52f9-45b5-a1dc-887bb7c022c9 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] HTTP exception thrown: Volume tempest-invalid-1692256453 could not be found. Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d9f397cb-52f9-45b5-a1dc-887bb7c022c9 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Request method failure captured: Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1692256453 HTTP/1.1 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2AlnJnPtRyEqDlt1-8fMhtIHQc6OblfzDWZ_H1qCGPUSDnRrDDjKyFppkp9xWU5feLIY-3NKqb2QYUIxhBDzmH4XGcnNvEZz1uexdmWxRJihaT9ucC1mOa0j4LnrcOO0ZVGW3pPf4Y2at2VBTgZrDDiIOdQJ1zaNcC4NGyes7fx9X0 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_865f6562c3704721aff6b41b28d075d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab61dd4bdcd4fbca82887335b237707 Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Volume tempest-invalid-1692256453 could not be found. Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'tempest-invalid-1692256453'} Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1692256453 could not be found. (HTTP 404) (Request-ID: req-a9369a45-d0f2-43b4-90c0-e28dd6d73719) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:53:57.772552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1692256453 could not be found. Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1692256453 could not be found. Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1692256453 could not be found. Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d9f397cb-52f9-45b5-a1dc-887bb7c022c9 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Returning 404 to user: Volume tempest-invalid-1692256453 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d9f397cb-52f9-45b5-a1dc-887bb7c022c9 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1692256453" status: 404 len: 99 microversion: 2.1 time: 0.035333 Jun 16 16:53:57.778066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 759/1124] 10.222.0.74 () {58 vars in 1217 bytes} [Thu Jun 16 16:53:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1692256453 => generated 99 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 16 16:53:57.784854 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7d695891-4637-4acd-b37d-a474fe523fbc tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004663 Jun 16 16:53:57.785360 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 760/1125] 10.222.0.74 () {58 vars in 1139 bytes} [Thu Jun 16 16:53:57 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 16:53:57.793263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e208f291-406d-4a90-9c68-e595bd3bfe21 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003248 Jun 16 16:53:57.793747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 761/1126] 10.222.0.74 () {58 vars in 1136 bytes} [Thu Jun 16 16:53:57 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 16 16:53:57.801431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-168bfb63-1800-4918-83fb-677c5e11255d tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Calling method '.version_select at 0x7fe5f8bf9040>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:57.837120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-168bfb63-1800-4918-83fb-677c5e11255d tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] HTTP exception thrown: Volume 78130b44-6fa1-4faf-9199-d5d43a31c5ce could not be found. Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-168bfb63-1800-4918-83fb-677c5e11255d tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Request method failure captured: Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/os-volumes/78130b44-6fa1-4faf-9199-d5d43a31c5ce HTTP/1.1 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2AlnJnPtRyEqDlt1-8fMhtIHQc6OblfzDWZ_H1qCGPUSDnRrDDjKyFppkp9xWU5feLIY-3NKqb2QYUIxhBDzmH4XGcnNvEZz1uexdmWxRJihaT9ucC1mOa0j4LnrcOO0ZVGW3pPf4Y2at2VBTgZrDDiIOdQJ1zaNcC4NGyes7fx9X0 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_865f6562c3704721aff6b41b28d075d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab61dd4bdcd4fbca82887335b237707 Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Volume 78130b44-6fa1-4faf-9199-d5d43a31c5ce could not be found. Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '78130b44-6fa1-4faf-9199-d5d43a31c5ce'} Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78130b44-6fa1-4faf-9199-d5d43a31c5ce could not be found. (HTTP 404) (Request-ID: req-58debbd1-d6a3-4e72-957a-a3c74cfaaf53) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:53:57.840138 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78130b44-6fa1-4faf-9199-d5d43a31c5ce could not be found. Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78130b44-6fa1-4faf-9199-d5d43a31c5ce could not be found. Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78130b44-6fa1-4faf-9199-d5d43a31c5ce could not be found. Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-168bfb63-1800-4918-83fb-677c5e11255d tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Returning 404 to user: Volume 78130b44-6fa1-4faf-9199-d5d43a31c5ce could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-168bfb63-1800-4918-83fb-677c5e11255d tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "DELETE /compute/v2.1/os-volumes/78130b44-6fa1-4faf-9199-d5d43a31c5ce" status: 404 len: 109 microversion: 2.1 time: 0.043420 Jun 16 16:53:57.845017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 762/1127] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:53:57 2022] DELETE /compute/v2.1/os-volumes/78130b44-6fa1-4faf-9199-d5d43a31c5ce => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:53:57.851090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3beb0750-d941-4fba-bd1c-490a87c45d11 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Calling method '.version_select at 0x7fe5fd2f8790>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:53:57.878851 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-3beb0750-d941-4fba-bd1c-490a87c45d11 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] HTTP exception thrown: Volume 1489ecf6-a807-4a26-ac9d-1ed73ee9f664 could not be found. Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3beb0750-d941-4fba-bd1c-490a87c45d11 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Request method failure captured: Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/os-volumes/1489ecf6-a807-4a26-ac9d-1ed73ee9f664 HTTP/1.1 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2AlnJnPtRyEqDlt1-8fMhtIHQc6OblfzDWZ_H1qCGPUSDnRrDDjKyFppkp9xWU5feLIY-3NKqb2QYUIxhBDzmH4XGcnNvEZz1uexdmWxRJihaT9ucC1mOa0j4LnrcOO0ZVGW3pPf4Y2at2VBTgZrDDiIOdQJ1zaNcC4NGyes7fx9X0 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/865f6562c3704721aff6b41b28d075d4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_865f6562c3704721aff6b41b28d075d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 865f6562c3704721aff6b41b28d075d4 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-VolumesNegativeTest-1918364859 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 5ab61dd4bdcd4fbca82887335b237707 Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-VolumesNegativeTest-1918364859-project Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Volume 1489ecf6-a807-4a26-ac9d-1ed73ee9f664 could not be found. Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '1489ecf6-a807-4a26-ac9d-1ed73ee9f664'} Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1489ecf6-a807-4a26-ac9d-1ed73ee9f664 could not be found. (HTTP 404) (Request-ID: req-0af20ae7-58ac-477f-b6b1-7de634dbf6a4) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 16 16:53:57.880904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1489ecf6-a807-4a26-ac9d-1ed73ee9f664 could not be found. Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1489ecf6-a807-4a26-ac9d-1ed73ee9f664 could not be found. Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1489ecf6-a807-4a26-ac9d-1ed73ee9f664 could not be found. Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3beb0750-d941-4fba-bd1c-490a87c45d11 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] Returning 404 to user: Volume 1489ecf6-a807-4a26-ac9d-1ed73ee9f664 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3beb0750-d941-4fba-bd1c-490a87c45d11 tempest-VolumesNegativeTest-1918364859 tempest-VolumesNegativeTest-1918364859-project] 10.222.0.74 "GET /compute/v2.1/os-volumes/1489ecf6-a807-4a26-ac9d-1ed73ee9f664" status: 404 len: 109 microversion: 2.1 time: 0.035032 Jun 16 16:53:57.885850 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 763/1128] 10.222.0.74 () {58 vars in 1244 bytes} [Thu Jun 16 16:53:57 2022] GET /compute/v2.1/os-volumes/1489ecf6-a807-4a26-ac9d-1ed73ee9f664 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:54:05.510522 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:54:05.511354 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:54:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:54:55.108898 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=11 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:54:55.109555 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:54:55.113705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:54:55.114193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:54:55.121207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:55.121644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:55.122397 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:55.122823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:55.216844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lazy-loading 'services' on Instance uuid 53a11b21-2cf2-45f9-9726-a3f7d7c191ae {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:54:55.294980 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3cfd4def-133a-4912-892c-a3627f916f9c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-volume_attachments/6f3d58a5-9c81-44f1-9ed7-eae39976ce83" status: 202 len: 0 microversion: 2.1 time: 0.187569 Jun 16 16:54:55.295771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 764/1129] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:54:55 2022] DELETE /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-volume_attachments/6f3d58a5-9c81-44f1-9ed7-eae39976ce83 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:54:57.505245 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ad072fc5-e699-4236-b1fb-6a769397f301 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:54:57.513747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad072fc5-e699-4236-b1fb-6a769397f301 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:57.514219 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ad072fc5-e699-4236-b1fb-6a769397f301 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:57.539446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ad072fc5-e699-4236-b1fb-6a769397f301 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Going to try to stop instance {{(pid=124104) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 16 16:54:57.588053 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ad072fc5-e699-4236-b1fb-6a769397f301 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action" status: 202 len: 0 microversion: 2.1 time: 0.090651 Jun 16 16:54:57.589098 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 765/1130] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:54:57 2022] POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:54:57.598494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:54:57.599360 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:54:57.607376 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:57.607893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:57.608666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:57.609101 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:57.747939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:54:57.757210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cf621945-eec6-4fa1-896f-2831cf6c8a36 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.163661 Jun 16 16:54:57.757889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 766/1131] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:54:57 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:54:58.775079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:54:58.775683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:54:58.782288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:58.782732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:58.783516 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:58.783924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:58.922224 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:54:58.930059 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ac7e1785-c840-4240-8829-bc4ae9778b56 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.159147 Jun 16 16:54:58.930752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 767/1132] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:54:58 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:54:59.949212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:54:59.950123 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:54:59.956747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:59.957160 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:54:59.958130 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:54:59.958747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:00.197763 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:00.205327 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-76926456-660f-4b78-96bd-528076aab20a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.261308 Jun 16 16:55:00.206122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 768/1133] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:54:59 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:01.223088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:01.223859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:01.232252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:01.232690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:01.233444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:01.234361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:01.442346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:01.452356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-97e73801-7490-4807-9494-2bc905cbfe5c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.233306 Jun 16 16:55:01.453104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 769/1134] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:01 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:02.469930 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:02.471465 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:02.478458 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:02.479464 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:02.480509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:02.481016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:02.640947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:02.654445 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c6f3004d-a9a6-4a10-bdf1-224303837a2a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.188447 Jun 16 16:55:02.655186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 770/1135] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:02 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:03.671790 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:03.673063 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:03.682095 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:03.682878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:03.683922 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:03.684349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:03.860869 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:03.877941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ada57514-9e6d-459c-8d27-42f3f6bc820d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.209943 Jun 16 16:55:03.879502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 771/1136] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:03 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:04.897012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:04.897700 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:04.905017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:04.905487 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:04.906239 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:04.906665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:05.171206 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:05.189204 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6de91f67-87c4-4c91-8a8f-90c4dc148423 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.296224 Jun 16 16:55:05.190164 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 772/1137] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:04 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:06.206853 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:06.207550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:06.218431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:06.218789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:06.220765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:06.221195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:06.579148 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:06.587901 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0f0756c6-960d-4cc1-a88d-23d306288732 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.384377 Jun 16 16:55:06.588494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 773/1138] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:06 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:07.606355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:07.607833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:07.617219 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:07.618158 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:07.620417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:07.621180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:07.914670 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:07.927290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3f7dbfd4-f451-49cb-a695-01a253eba753 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.325684 Jun 16 16:55:07.928758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 774/1139] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:07 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:08.944551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:08.945144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:08.951474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:08.951920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:08.952676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:08.953084 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:09.170371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:09.179221 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0f11db79-8b96-410f-a5fa-8c861a239db9 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.238873 Jun 16 16:55:09.179819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 775/1140] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:08 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:10.196613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:10.197919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:10.217570 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:10.218278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:10.219250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:10.219827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:10.509602 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:10.521019 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cf006f66-0ac3-4577-bdaa-d70cda0f9859 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.328217 Jun 16 16:55:10.522442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 776/1141] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:10 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:11.539686 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:11.541369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:11.554769 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:11.555642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:11.556485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:11.560326 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:12.112048 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:12.123331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-95a7f80a-b9a0-41a2-85e5-19d048fdb42d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.588033 Jun 16 16:55:12.124225 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 777/1142] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:11 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:13.143947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:13.145212 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:13.154150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:13.154856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:13.155941 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:13.156774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:13.391984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:13.397792 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:13.407654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-06902d34-cef1-4c7c-a28f-b86840798f34 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.267687 Jun 16 16:55:13.413953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 778/1143] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:13 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:14.433441 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:14.434125 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:14.442107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:14.442914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:14.443800 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:14.444394 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:14.671450 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:14.681247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-80b3d3cf-1cc6-4b16-a997-88020dbbb5cb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.253534 Jun 16 16:55:14.682797 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 779/1144] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:14 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:15.702058 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:15.702828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:15.712815 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:15.713416 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:15.714410 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:15.715011 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:15.917461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:15.926228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2e1b5f0e-4fca-4a83-8247-f79c53d86411 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1672 microversion: 2.1 time: 0.230929 Jun 16 16:55:15.927252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 780/1145] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:15 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1672 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:16.945184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:16.946590 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:16.953870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:16.954316 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:16.955328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:16.955760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:17.184841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:17.202960 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6fc01e02-7bac-4f42-92af-f9e63bdd7b64 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1649 microversion: 2.1 time: 0.262129 Jun 16 16:55:17.217517 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 781/1146] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:16 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1649 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:17.222773 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-951de83d-388a-4607-aba4-37375fdd946d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:17.230113 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-951de83d-388a-4607-aba4-37375fdd946d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:17.230844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-951de83d-388a-4607-aba4-37375fdd946d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:17.259455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-951de83d-388a-4607-aba4-37375fdd946d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Going to try to start instance {{(pid=124104) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 16 16:55:17.316680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-951de83d-388a-4607-aba4-37375fdd946d tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action" status: 202 len: 0 microversion: 2.1 time: 0.097684 Jun 16 16:55:17.318811 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 782/1147] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:55:17 2022] POST /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:55:17.331341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:17.333157 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:17.347392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:17.348114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:17.348900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:17.349331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:17.602010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:17.617137 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9bbbe728-ea33-4b92-a13d-de6a5a3f2834 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1658 microversion: 2.1 time: 0.292422 Jun 16 16:55:17.618097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 783/1148] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:17 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1658 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:18.635032 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:18.635773 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:18.646161 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:18.646872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:18.647852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:18.648663 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:18.853667 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:18.863278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ea53508f-01a0-497b-9283-60e43eb98f01 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1658 microversion: 2.1 time: 0.231105 Jun 16 16:55:18.863884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 784/1149] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:18 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1658 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:19.690849 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-54786061-11f3-4726-b0b2-a8f634945853 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Action: 'create', calling method: .version_select at 0x7fe5f8bcc0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1625831900", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJOycvS2lf+Tbng7qWyAUXFWF2LA89CPa5MvKCKGIUwWDjNaQTmhLbw8ET99SF7QMafCMxAlocijjwRXil+zyMcF+3QJXC+4x5RJqbppdmp3kFSocias6NhXTk/0GZtgCQ=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:19.705535 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-54786061-11f3-4726-b0b2-a8f634945853 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Getting quotas for project 0a55a4c28c4140958e1c078eaf57f9fd. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:55:19.709319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-54786061-11f3-4726-b0b2-a8f634945853 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Getting quotas for user 690436e83b26412cb5c84f47202834f4 and project 0a55a4c28c4140958e1c078eaf57f9fd. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:55:19.733215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-54786061-11f3-4726-b0b2-a8f634945853 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046122 Jun 16 16:55:19.733829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 785/1150] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:55:19 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:55:19.839552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-726690663", "imageRef": "ef36cdd5-8a11-4b10-8150-8a36b6fe1af4", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1625831900", "networks": [{"uuid": "d55aed8d-d1d0-40ab-bc92-0e06012af9b0"}]}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:19.893285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] validate_networks() for [('d55aed8d-d1d0-40ab-bc92-0e06012af9b0', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:55:20.451331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:55:20.451748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:55:20.452203 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:55:20.452627 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:55:20.453023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:55:20.462676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:20.463270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:20.464061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:20.464536 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:20.481946 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Getting quotas for project 0a55a4c28c4140958e1c078eaf57f9fd. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:55:20.486495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Getting quotas for user 690436e83b26412cb5c84f47202834f4 and project 0a55a4c28c4140958e1c078eaf57f9fd. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:55:20.498042 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:55:20.500318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ef36cdd5-8a11-4b10-8150-8a36b6fe1af4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:55:20.545800 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0e9356ee-b3eb-4742-99d6-cd3a178c2c83 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.710115 Jun 16 16:55:20.546650 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 786/1151] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:55:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 16 16:55:20.552122 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:20.552774 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:20.559696 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:20.560379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:20.561265 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:20.561690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:20.695928 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:20.704424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-11841891-c7eb-4993-a4e6-db80dd4ebf20 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1662 microversion: 2.1 time: 0.156256 Jun 16 16:55:20.705109 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 787/1152] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:20 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:20.709617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-89a608c4-e9bb-477e-a376-2fd0cdef6b5d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:20.710469 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-89a608c4-e9bb-477e-a376-2fd0cdef6b5d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:20.771675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-89a608c4-e9bb-477e-a376-2fd0cdef6b5d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:20.783018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-89a608c4-e9bb-477e-a376-2fd0cdef6b5d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1258 microversion: 2.1 time: 0.076834 Jun 16 16:55:20.783830 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 788/1153] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:20 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:21.799488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:21.800111 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:21.808526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:21.808969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:21.809785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:21.810214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:21.882855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:21.890969 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-763d1981-b884-4de5-97f2-0988c5c27d8c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1316 microversion: 2.1 time: 0.095435 Jun 16 16:55:21.891626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 789/1154] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:21 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1316 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:22.909684 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:22.911473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:22.919871 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:22.920312 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:22.921079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:22.921526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:23.117979 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:23.126258 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9c9a3ff9-5361-4ed3-b213-8e32f38d0c6f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.221166 Jun 16 16:55:23.127566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 790/1155] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:22 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:24.148210 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:24.150509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:24.161017 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:24.161762 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:24.163091 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:24.164097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:24.309995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:24.318455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a4ab059b-99c0-45c6-8c49-1285929631b8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.178141 Jun 16 16:55:24.319060 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 791/1156] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:24 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:25.336134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:25.336947 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:25.343924 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:25.351379 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:25.352936 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:25.353881 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:25.354393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:25.566519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:25.575934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f706b68c-bfe9-4a6b-8265-43e168a46f30 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.244133 Jun 16 16:55:25.576723 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 792/1157] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:25 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:26.593716 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:26.595367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:26.606678 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:26.607489 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:26.608671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:26.611364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:26.810623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:26.819297 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-db705bd5-91d6-42f1-b10e-8285d665b66c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.229751 Jun 16 16:55:26.820119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 793/1158] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:26 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:27.837714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:27.839232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:27.846753 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:27.847501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:27.848585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:27.849235 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:27.989588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:27.997747 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9eb8cfd4-83f2-415c-9970-1825134c9a84 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.164563 Jun 16 16:55:27.998342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 794/1159] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:27 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:29.015460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:29.016177 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:29.023047 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:29.023665 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:29.024422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:29.024843 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:29.173473 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:29.181565 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0af2bf28-2c28-4098-9d0a-f7194934609f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.170369 Jun 16 16:55:29.182152 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 795/1160] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:29 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:30.199771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:30.200477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:30.207182 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:30.207715 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:30.208498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:30.208991 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:30.357008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:30.364654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4f3f68da-c917-4e12-b438-62c04985384c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.169482 Jun 16 16:55:30.365237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 796/1161] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:30 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:31.382061 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:31.382855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:31.384688 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:31.385396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=12 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:31.392499 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:31.392944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:31.393709 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:31.394139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:31.398489 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:31.532360 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:31.540288 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-34c4c9c5-e71d-4937-abaa-ee7f3b385cb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.162186 Jun 16 16:55:31.540865 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 797/1162] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:31 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:32.557576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:32.558199 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:32.565201 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:32.565637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:32.566384 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:32.566799 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:32.702680 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:32.710358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2ce83dec-8f4e-4d55-807f-83d674d4feda tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.156842 Jun 16 16:55:32.711336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 798/1163] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:32 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:33.728048 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:33.728720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:33.735646 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:33.736089 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:33.736841 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:33.737271 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:34.112116 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:34.119712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e756b825-2a28-4f67-bed5-b377ae2ca080 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.395942 Jun 16 16:55:34.120328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 799/1164] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:33 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:35.136586 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:35.137605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:35.145551 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:35.146002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:35.146772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:35.147268 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:35.295803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:35.303743 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-58a27b44-984f-4485-99e6-4095518197f4 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.171036 Jun 16 16:55:35.304436 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 800/1165] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:35 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:35.390179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-8989c5f4-d2cd-47ab-8e1b-3a08d89a5720 req-7f29a731-a63c-4800-9a6e-b8328e346a6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8573b1cc-9337-4615-916b-af0b9326f737", "tag": "a3912793-66cc-4f4c-9135-270beeb0c85a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:35.404827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-8989c5f4-d2cd-47ab-8e1b-3a08d89a5720 req-7f29a731-a63c-4800-9a6e-b8328e346a6a service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:35.405352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-8989c5f4-d2cd-47ab-8e1b-3a08d89a5720 req-7f29a731-a63c-4800-9a6e-b8328e346a6a service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:35.417674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-8989c5f4-d2cd-47ab-8e1b-3a08d89a5720 req-7f29a731-a63c-4800-9a6e-b8328e346a6a service nova] Creating event network-changed:a3912793-66cc-4f4c-9135-270beeb0c85a for instance 8573b1cc-9337-4615-916b-af0b9326f737 on hv-cinder-83735 Jun 16 16:55:35.422787 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-8989c5f4-d2cd-47ab-8e1b-3a08d89a5720 req-7f29a731-a63c-4800-9a6e-b8328e346a6a service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041853 Jun 16 16:55:35.423529 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 801/1166] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:55:36.322592 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:36.323280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:36.330086 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:36.330524 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:36.331327 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:36.331756 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:36.477201 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:36.489693 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4ec4f1b8-da34-43de-9da5-81ec8b539955 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.171876 Jun 16 16:55:36.490635 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 802/1167] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:36 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:37.507827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:37.508573 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:37.515793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:37.516239 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:37.516992 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:37.517415 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:37.646810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:37.655139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-69d7fced-d6c7-41ea-b722-5f21a969d7af tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.151459 Jun 16 16:55:37.655722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 803/1168] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:37 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:38.674657 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:38.675872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:38.683769 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:38.684208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:38.684962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:38.685380 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:38.819264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:38.826954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-94acd217-be72-4eb0-85ea-2424c2fa2abe tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.158210 Jun 16 16:55:38.827649 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 804/1169] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:38 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:39.844896 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:39.845581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:39.852768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:39.853207 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:39.853974 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:39.854404 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:39.996232 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:40.006081 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-891bad39-474e-46ce-bb8b-155c260f8309 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.165185 Jun 16 16:55:40.006948 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 805/1170] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:39 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:41.024502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:41.025187 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:41.032125 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:41.032564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:41.033310 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:41.033727 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:41.171870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:41.179782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ff966933-31ef-403b-b6c9-b77591c9c48d tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.159408 Jun 16 16:55:41.180331 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 806/1171] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:41 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:42.034139 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-1e93adf5-715d-4b73-9f63-bd61a3a7f266 req-c204e4d6-781e-47c8-864a-ef449a8af429 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8573b1cc-9337-4615-916b-af0b9326f737", "name": "network-vif-plugged", "status": "completed", "tag": "a3912793-66cc-4f4c-9135-270beeb0c85a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:42.043690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1e93adf5-715d-4b73-9f63-bd61a3a7f266 req-c204e4d6-781e-47c8-864a-ef449a8af429 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:42.044127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1e93adf5-715d-4b73-9f63-bd61a3a7f266 req-c204e4d6-781e-47c8-864a-ef449a8af429 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:42.056423 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-1e93adf5-715d-4b73-9f63-bd61a3a7f266 req-c204e4d6-781e-47c8-864a-ef449a8af429 service nova] Creating event network-vif-plugged:a3912793-66cc-4f4c-9135-270beeb0c85a for instance 8573b1cc-9337-4615-916b-af0b9326f737 on hv-cinder-83735 Jun 16 16:55:42.061283 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-1e93adf5-715d-4b73-9f63-bd61a3a7f266 req-c204e4d6-781e-47c8-864a-ef449a8af429 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030943 Jun 16 16:55:42.061931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 807/1172] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:55:42.197783 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:42.198655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:42.205350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:42.205796 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:42.206563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:42.207033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:42.349040 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:42.357432 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2e1a7485-e1b6-4bfb-89fd-b3ec74240a4e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.164585 Jun 16 16:55:42.359733 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 808/1173] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:42 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:43.374875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:43.375642 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:43.383079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:43.383543 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:43.384305 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:43.384734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:43.520714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:43.528940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eb9fdb05-b631-4a44-bbe5-ea78f78b8d24 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1358 microversion: 2.1 time: 0.158056 Jun 16 16:55:43.529511 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 809/1174] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:43 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:44.546889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:44.547608 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:44.555591 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:44.556055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:44.556827 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:44.557254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:44.694528 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:44.702712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a31f0ab9-8952-4d5e-bf9f-e2f17b40f1cc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1548 microversion: 2.1 time: 0.159645 Jun 16 16:55:44.703351 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 810/1175] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:44 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:44.719342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:44.719940 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:44.726374 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:44.726704 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:44.727478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:44.727896 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:44.870051 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:44.877734 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3378bd4b-e545-4130-bd77-51968f8f00c3 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1548 microversion: 2.1 time: 0.162244 Jun 16 16:55:44.878302 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 811/1176] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:44 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:44.894560 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:44.898994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:44.899821 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Searching by: {'deleted': False, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd'} {{(pid=124104) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 16 16:55:44.907128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:44.907579 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:44.908362 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:44.908788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:45.004442 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.multi_cell_list [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124104) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 16 16:55:45.102919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c0e781bc-1b9d-4f0e-b64a-b205664a6240 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212299 Jun 16 16:55:45.103470 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 812/1177] 10.222.0.74 () {58 vars in 1124 bytes} [Thu Jun 16 16:55:44 2022] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:55:45.113510 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:45.114111 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:45.121344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:45.121795 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:45.122548 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:45.122993 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:45.267309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:45.275720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8da94fdc-9818-4f58-9fed-b6fc418c6d41 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1548 microversion: 2.1 time: 0.165919 Jun 16 16:55:45.276304 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 813/1178] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:45 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:55:46.814935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-220b63c5-f434-4098-8017-d57ed244c2ed tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "febe8a91-d7b9-4b2f-89c5-1e5a8a226961"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:46.815939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-220b63c5-f434-4098-8017-d57ed244c2ed tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:46.822588 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-220b63c5-f434-4098-8017-d57ed244c2ed tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:46.823023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-220b63c5-f434-4098-8017-d57ed244c2ed tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:46.823809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-220b63c5-f434-4098-8017-d57ed244c2ed tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:46.824231 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-220b63c5-f434-4098-8017-d57ed244c2ed tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:47.068724 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=100 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:47.276474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-220b63c5-f434-4098-8017-d57ed244c2ed tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465423 Jun 16 16:55:47.277097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 814/1179] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:55:46 2022] POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:55:49.795400 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:55:49.796040 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:55:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:55:54.845174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:54.845861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:54.852451 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:54.852889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:54.853643 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:54.854066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:54.944561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:54.993905 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:55.002461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-64f357b8-4c6f-49bc-97ba-6f7ada97ab9a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1594 microversion: 2.1 time: 0.162294 Jun 16 16:55:55.003002 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 815/1180] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:54 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1594 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:56.721878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-0eba0619-92ab-43bb-93d5-de0bba2cbcd7 req-0dff807d-4219-44c5-98c5-5b1d7ef87dcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8573b1cc-9337-4615-916b-af0b9326f737", "tag": "a3912793-66cc-4f4c-9135-270beeb0c85a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:56.730461 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=48 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:55:56.734263 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-0eba0619-92ab-43bb-93d5-de0bba2cbcd7 req-0dff807d-4219-44c5-98c5-5b1d7ef87dcd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:56.734712 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-0eba0619-92ab-43bb-93d5-de0bba2cbcd7 req-0dff807d-4219-44c5-98c5-5b1d7ef87dcd service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:56.748361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-0eba0619-92ab-43bb-93d5-de0bba2cbcd7 req-0dff807d-4219-44c5-98c5-5b1d7ef87dcd service nova] Creating event network-changed:a3912793-66cc-4f4c-9135-270beeb0c85a for instance 8573b1cc-9337-4615-916b-af0b9326f737 on hv-cinder-83735 Jun 16 16:55:56.753596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-0eba0619-92ab-43bb-93d5-de0bba2cbcd7 req-0dff807d-4219-44c5-98c5-5b1d7ef87dcd service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035476 Jun 16 16:55:56.754204 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 816/1181] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:55:57.872005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1087014230"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:57.872649 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:57.879322 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:57.879701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:57.880452 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:57.880897 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:58.009771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.network.security_group_api [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Adding security group 9d6749c7-ff30-4384-be32-50ed03eac9f2 to port a3912793-66cc-4f4c-9135-270beeb0c85a Jun 16 16:55:58.373419 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c10c4a94-c731-4eb8-9117-2f1afdfb6ae0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/action" status: 202 len: 0 microversion: 2.1 time: 0.506531 Jun 16 16:55:58.374242 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 817/1182] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:55:57 2022] POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:55:58.383311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:55:58.384060 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:55:58.391307 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:58.392010 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:58.393553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:58.394848 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:58.798736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:55:58.807520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-298891ec-5684-4871-8418-f1d9088150b1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1760 microversion: 2.1 time: 0.428720 Jun 16 16:55:58.819146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 818/1183] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:55:58 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1760 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:55:58.824319 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-11d1b73e-dd12-4010-9635-441e70ee8c1e req-13b413f0-6e9d-4fbb-a4ab-a3b0c7d30dcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8573b1cc-9337-4615-916b-af0b9326f737", "tag": "a3912793-66cc-4f4c-9135-270beeb0c85a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:55:58.832726 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-11d1b73e-dd12-4010-9635-441e70ee8c1e req-13b413f0-6e9d-4fbb-a4ab-a3b0c7d30dcf service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:55:58.833163 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-11d1b73e-dd12-4010-9635-441e70ee8c1e req-13b413f0-6e9d-4fbb-a4ab-a3b0c7d30dcf service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:55:58.844840 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-11d1b73e-dd12-4010-9635-441e70ee8c1e req-13b413f0-6e9d-4fbb-a4ab-a3b0c7d30dcf service nova] Creating event network-changed:a3912793-66cc-4f4c-9135-270beeb0c85a for instance 8573b1cc-9337-4615-916b-af0b9326f737 on hv-cinder-83735 Jun 16 16:55:58.850146 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-11d1b73e-dd12-4010-9635-441e70ee8c1e req-13b413f0-6e9d-4fbb-a4ab-a3b0c7d30dcf service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029317 Jun 16 16:55:58.850771 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 819/1184] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:13.949920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=7 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:56:13.950658 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:56:13.955444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:13.956036 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:13.964967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:13.965418 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:13.966214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:13.966647 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:13.994513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:56:14.081550 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4c1ef1cb-b22d-4ff1-9d92-b8859a5b45de tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "DELETE /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 204 len: 0 microversion: 2.1 time: 0.132913 Jun 16 16:56:14.082307 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 820/1185] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:56:13 2022] DELETE /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:56:14.088861 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-1a486811-c6d6-4851-9b61-4d7113478e78 req-299c72f1-94c9-411d-ae03-01fa56e90bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aec4ea5b-d19a-49d8-99d0-63a377e92780", "tag": "93acf8d3-b813-4157-9e5c-ed11b71411cb"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:14.098361 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1a486811-c6d6-4851-9b61-4d7113478e78 req-299c72f1-94c9-411d-ae03-01fa56e90bc4 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:14.098805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1a486811-c6d6-4851-9b61-4d7113478e78 req-299c72f1-94c9-411d-ae03-01fa56e90bc4 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:14.111367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-1a486811-c6d6-4851-9b61-4d7113478e78 req-299c72f1-94c9-411d-ae03-01fa56e90bc4 service nova] Creating event network-changed:93acf8d3-b813-4157-9e5c-ed11b71411cb for instance aec4ea5b-d19a-49d8-99d0-63a377e92780 on hv-cinder-83735 Jun 16 16:56:14.116870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-1a486811-c6d6-4851-9b61-4d7113478e78 req-299c72f1-94c9-411d-ae03-01fa56e90bc4 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032968 Jun 16 16:56:14.117829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 821/1186] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:14.123183 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:14.123876 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:14.130844 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:14.131485 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:14.132254 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:14.132681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:14.271613 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:14.279759 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-930566ee-eb27-4ec7-bc8b-255cf8cb706f tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1576 microversion: 2.1 time: 0.160638 Jun 16 16:56:14.280429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 822/1187] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:14 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:15.298027 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:15.298661 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:15.306519 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:15.306965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:15.307765 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:15.308196 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:15.447894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:15.455730 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-33c1b4db-a2d2-4101-9d1d-1baf6b692ebe tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1576 microversion: 2.1 time: 0.161635 Jun 16 16:56:15.456536 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 823/1188] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:15 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:16.473825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:16.473825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:16.481117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:16.481557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:16.482323 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:16.482925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:16.562761 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:16.571007 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ae364eed-a503-472a-a37a-05ebc7e1b8fa tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 200 len: 1389 microversion: 2.1 time: 0.101905 Jun 16 16:56:16.571626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 824/1189] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:16 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 1389 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:16.576053 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-b75faa00-20a8-4ca9-99c0-bf890cf61fd7 req-1602868c-2187-4ad0-815f-9ea44bd68132 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aec4ea5b-d19a-49d8-99d0-63a377e92780", "name": "network-vif-deleted", "tag": "93acf8d3-b813-4157-9e5c-ed11b71411cb"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:16.584858 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-b75faa00-20a8-4ca9-99c0-bf890cf61fd7 req-1602868c-2187-4ad0-815f-9ea44bd68132 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:16.585294 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-b75faa00-20a8-4ca9-99c0-bf890cf61fd7 req-1602868c-2187-4ad0-815f-9ea44bd68132 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:16.598430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-b75faa00-20a8-4ca9-99c0-bf890cf61fd7 req-1602868c-2187-4ad0-815f-9ea44bd68132 service nova] Creating event network-vif-deleted:93acf8d3-b813-4157-9e5c-ed11b71411cb for instance aec4ea5b-d19a-49d8-99d0-63a377e92780 on hv-cinder-83735 Jun 16 16:56:16.603685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-b75faa00-20a8-4ca9-99c0-bf890cf61fd7 req-1602868c-2187-4ad0-815f-9ea44bd68132 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030919 Jun 16 16:56:16.604296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 825/1190] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:17.589180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:17.589859 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: aec4ea5b-d19a-49d8-99d0-63a377e92780] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:17.597077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:17.597518 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:17.598278 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:17.598708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:17.612704 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] HTTP exception thrown: Instance aec4ea5b-d19a-49d8-99d0-63a377e92780 could not be found. Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Request method failure captured: Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 HTTP/1.1 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq14rjYEqpLx_inEHgBTxGxsrBN2k83x37FmhAN5yTItgX1ExLvy9nKoxAUdyhfA_VX2WN1YCuA0tnykvxt8AtAt228YGWAs2y7p5PCenJP8axnTeQ7b9fANh0iwnSTqqIKbIr_LbxXUhp44jBhAsm6uENkdvyT59ilG2bi_RwlNeVUg Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d162fcafed2c4ae099a5786cceb84891 Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance aec4ea5b-d19a-49d8-99d0-63a377e92780 could not be found. Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'aec4ea5b-d19a-49d8-99d0-63a377e92780'} Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aec4ea5b-d19a-49d8-99d0-63a377e92780 could not be found. Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aec4ea5b-d19a-49d8-99d0-63a377e92780 could not be found. Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:17.614340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aec4ea5b-d19a-49d8-99d0-63a377e92780 could not be found. Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Returning 404 to user: Instance aec4ea5b-d19a-49d8-99d0-63a377e92780 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b5d97d1a-422e-47f2-adc0-913fa24654ab tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780" status: 404 len: 111 microversion: 2.1 time: 0.031014 Jun 16 16:56:17.619392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 826/1191] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:17 2022] GET /compute/v2.1/servers/aec4ea5b-d19a-49d8-99d0-63a377e92780 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:56:21.730593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:21.731377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:21.737935 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:21.738387 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:21.739189 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:21.739625 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:21.766981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:56:21.851812 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-02cc0e00-28f7-488c-856f-5b4d468b3f23 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "DELETE /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 204 len: 0 microversion: 2.1 time: 0.124866 Jun 16 16:56:21.852443 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 827/1192] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:56:21 2022] DELETE /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:56:21.857697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-838d56b3-d8c3-4b0c-a89c-81ef1a7b0d9a req-684a4b3e-01aa-4cd4-ae4a-cfd3aac8db9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e76e921c-2e7d-4724-aea0-959173d115c6", "tag": "1b6f4fb1-8296-41be-95a6-2cb715710627"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:21.866510 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-838d56b3-d8c3-4b0c-a89c-81ef1a7b0d9a req-684a4b3e-01aa-4cd4-ae4a-cfd3aac8db9f service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:21.866964 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-838d56b3-d8c3-4b0c-a89c-81ef1a7b0d9a req-684a4b3e-01aa-4cd4-ae4a-cfd3aac8db9f service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:21.878197 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-838d56b3-d8c3-4b0c-a89c-81ef1a7b0d9a req-684a4b3e-01aa-4cd4-ae4a-cfd3aac8db9f service nova] Creating event network-changed:1b6f4fb1-8296-41be-95a6-2cb715710627 for instance e76e921c-2e7d-4724-aea0-959173d115c6 on hv-cinder-83735 Jun 16 16:56:21.883998 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-838d56b3-d8c3-4b0c-a89c-81ef1a7b0d9a req-684a4b3e-01aa-4cd4-ae4a-cfd3aac8db9f service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030207 Jun 16 16:56:21.884598 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 828/1193] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:21.890018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:21.890714 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:21.897968 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:21.898414 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:21.899230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:21.899659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:22.037819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:22.045817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-51e4404d-beec-451a-ad77-bf0f1ed486f9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1576 microversion: 2.1 time: 0.160064 Jun 16 16:56:22.046636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 829/1194] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:21 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:23.063862 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:23.065280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:23.072389 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:23.073102 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:23.073888 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:23.074479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:23.218966 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd162fcafed2c4ae099a5786cceb84891', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '256a9b5f5ad1405bb9fe21d591ef677d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:23.228377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-367c46ba-4f29-4c0b-b897-ef382477fbe7 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 200 len: 1576 microversion: 2.1 time: 0.168462 Jun 16 16:56:23.228973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 830/1195] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:23 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:23.365159 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-aaeec59c-a7a1-40eb-919c-60a0451c7cd9 req-e2ee3524-cb39-4d7f-b2a1-ea67c5af5955 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e76e921c-2e7d-4724-aea0-959173d115c6", "name": "network-vif-deleted", "tag": "1b6f4fb1-8296-41be-95a6-2cb715710627"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:23.375786 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-aaeec59c-a7a1-40eb-919c-60a0451c7cd9 req-e2ee3524-cb39-4d7f-b2a1-ea67c5af5955 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:23.376226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-aaeec59c-a7a1-40eb-919c-60a0451c7cd9 req-e2ee3524-cb39-4d7f-b2a1-ea67c5af5955 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:23.388836 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-aaeec59c-a7a1-40eb-919c-60a0451c7cd9 req-e2ee3524-cb39-4d7f-b2a1-ea67c5af5955 service nova] Creating event network-vif-deleted:1b6f4fb1-8296-41be-95a6-2cb715710627 for instance e76e921c-2e7d-4724-aea0-959173d115c6 on hv-cinder-83735 Jun 16 16:56:23.394879 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-aaeec59c-a7a1-40eb-919c-60a0451c7cd9 req-e2ee3524-cb39-4d7f-b2a1-ea67c5af5955 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033119 Jun 16 16:56:23.396047 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 831/1196] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:24.246377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:24.247083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: e76e921c-2e7d-4724-aea0-959173d115c6] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:24.255230 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:24.255744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:24.256520 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:24.257020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:24.273626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] HTTP exception thrown: Instance e76e921c-2e7d-4724-aea0-959173d115c6 could not be found. Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Request method failure captured: Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 HTTP/1.1 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq14rjYEqpLx_inEHgBTxGxsrBN2k83x37FmhAN5yTItgX1ExLvy9nKoxAUdyhfA_VX2WN1YCuA0tnykvxt8AtAt228YGWAs2y7p5PCenJP8axnTeQ7b9fANh0iwnSTqqIKbIr_LbxXUhp44jBhAsm6uENkdvyT59ilG2bi_RwlNeVUg Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d162fcafed2c4ae099a5786cceb84891 Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance e76e921c-2e7d-4724-aea0-959173d115c6 could not be found. Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': 'e76e921c-2e7d-4724-aea0-959173d115c6'} Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e76e921c-2e7d-4724-aea0-959173d115c6 could not be found. Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e76e921c-2e7d-4724-aea0-959173d115c6 could not be found. Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:24.275349 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e76e921c-2e7d-4724-aea0-959173d115c6 could not be found. Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Returning 404 to user: Instance e76e921c-2e7d-4724-aea0-959173d115c6 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4b80e3dd-9ef5-4f7a-afce-c38921a4cf0a tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6" status: 404 len: 111 microversion: 2.1 time: 0.034705 Jun 16 16:56:24.280264 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 832/1197] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:24 2022] GET /compute/v2.1/servers/e76e921c-2e7d-4724-aea0-959173d115c6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:56:24.718428 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:24.718914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:24.725173 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:24.725626 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:24.726378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:24.726802 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:24.740399 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] HTTP exception thrown: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Request method failure captured: Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 HTTP/1.1 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq14rjYEqpLx_inEHgBTxGxsrBN2k83x37FmhAN5yTItgX1ExLvy9nKoxAUdyhfA_VX2WN1YCuA0tnykvxt8AtAt228YGWAs2y7p5PCenJP8axnTeQ7b9fANh0iwnSTqqIKbIr_LbxXUhp44jBhAsm6uENkdvyT59ilG2bi_RwlNeVUg Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d162fcafed2c4ae099a5786cceb84891 Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '8e74018d-237a-4638-972d-b5b85e487dc5'} Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:56:24.741952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Returning 404 to user: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7370994a-53f8-4b2b-ad52-62ee799c3f05 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 404 len: 111 microversion: 2.1 time: 0.028891 Jun 16 16:56:24.746424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 833/1198] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:56:24 2022] DELETE /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:56:24.751742 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:24.752339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] [instance: 8e74018d-237a-4638-972d-b5b85e487dc5] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:24.758973 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:24.759431 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:24.760179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:24.760597 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:24.774996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] HTTP exception thrown: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Request method failure captured: Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 HTTP/1.1 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq14rjYEqpLx_inEHgBTxGxsrBN2k83x37FmhAN5yTItgX1ExLvy9nKoxAUdyhfA_VX2WN1YCuA0tnykvxt8AtAt228YGWAs2y7p5PCenJP8axnTeQ7b9fANh0iwnSTqqIKbIr_LbxXUhp44jBhAsm6uENkdvyT59ilG2bi_RwlNeVUg Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_256a9b5f5ad1405bb9fe21d591ef677d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 256a9b5f5ad1405bb9fe21d591ef677d Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestVolumeBootPattern-138176052 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d162fcafed2c4ae099a5786cceb84891 Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestVolumeBootPattern-138176052-project Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '8e74018d-237a-4638-972d-b5b85e487dc5'} Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:24.776557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Returning 404 to user: Instance 8e74018d-237a-4638-972d-b5b85e487dc5 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-378f3727-76c6-4388-a0d5-9c9e6eb1dca9 tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5" status: 404 len: 111 microversion: 2.1 time: 0.029765 Jun 16 16:56:24.782546 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 834/1199] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:24 2022] GET /compute/v2.1/servers/8e74018d-237a-4638-972d-b5b85e487dc5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:56:26.080950 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-46003d5c-5b5b-467c-83c9-01c74a95208e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] Calling method '.version_select at 0x7fe5fd2db790>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:26.105447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-46003d5c-5b5b-467c-83c9-01c74a95208e tempest-TestVolumeBootPattern-138176052 tempest-TestVolumeBootPattern-138176052-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-863924614" status: 202 len: 0 microversion: 2.1 time: 0.028344 Jun 16 16:56:26.105949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 835/1200] 10.222.0.74 () {58 vars in 1259 bytes} [Thu Jun 16 16:56:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-863924614 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:56:27.865873 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:56:27.866421 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:56:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:56:32.445145 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-627a6acb-5076-4eeb-8a4f-56c97fcfc55f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:32.446671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-627a6acb-5076-4eeb-8a4f-56c97fcfc55f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:32.455005 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-627a6acb-5076-4eeb-8a4f-56c97fcfc55f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:32.455552 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-627a6acb-5076-4eeb-8a4f-56c97fcfc55f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:32.456584 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-627a6acb-5076-4eeb-8a4f-56c97fcfc55f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:32.457287 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-627a6acb-5076-4eeb-8a4f-56c97fcfc55f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:32.494033 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-627a6acb-5076-4eeb-8a4f-56c97fcfc55f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053196 Jun 16 16:56:32.494739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 836/1201] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:56:32 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:56:32.558239 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:32.559321 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:32.566710 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:32.567460 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:32.568500 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:32.569377 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:32.606710 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:56:32.670676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:56:32.717833 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9d977b7e-8aa9-488f-ace1-8c642792ac96 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 204 len: 0 microversion: 2.1 time: 0.162890 Jun 16 16:56:32.719191 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 837/1202] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:56:32 2022] DELETE /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:56:32.729055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:32.729904 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:32.743267 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:32.744417 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:32.745220 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:32.745645 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:32.986339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:32.994328 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-46d3eb15-4467-4137-8afe-acf227e3e985 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1668 microversion: 2.1 time: 0.269954 Jun 16 16:56:32.995016 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 838/1203] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:32 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1668 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:34.012493 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:34.013193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:34.019708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:34.020120 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:34.020931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:34.021359 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:34.164393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:34.172701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-433696d3-b7bc-4ccd-8748-3efdf6f6c335 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1668 microversion: 2.1 time: 0.164616 Jun 16 16:56:34.173311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 839/1204] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:34 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1668 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:56:34.956917 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-6d197f66-c6c1-4ccd-83ea-c664d23addff req-791ff111-11a8-4dd5-96c1-6c308adcf75c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53a11b21-2cf2-45f9-9726-a3f7d7c191ae", "name": "network-vif-deleted", "tag": "70531c65-24e2-4f59-8bac-070440cfec7e"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:34.967021 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6d197f66-c6c1-4ccd-83ea-c664d23addff req-791ff111-11a8-4dd5-96c1-6c308adcf75c service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:34.967513 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-6d197f66-c6c1-4ccd-83ea-c664d23addff req-791ff111-11a8-4dd5-96c1-6c308adcf75c service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:34.979925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-6d197f66-c6c1-4ccd-83ea-c664d23addff req-791ff111-11a8-4dd5-96c1-6c308adcf75c service nova] Creating event network-vif-deleted:70531c65-24e2-4f59-8bac-070440cfec7e for instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae on hv-cinder-83735 Jun 16 16:56:34.985107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-6d197f66-c6c1-4ccd-83ea-c664d23addff req-791ff111-11a8-4dd5-96c1-6c308adcf75c service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jun 16 16:56:34.985722 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 840/1205] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:35.191705 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:35.192894 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:35.199403 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:35.200103 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:35.200628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:35.201056 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:35.234057 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:35.234507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:35.234949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lazy-loading 'fault' on Instance uuid 53a11b21-2cf2-45f9-9726-a3f7d7c191ae {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:56:35.278234 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:35.285875 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8f1321bd-e649-474b-9cfe-60bf3392f600 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 200 len: 1326 microversion: 2.1 time: 0.098938 Jun 16 16:56:35.286563 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 841/1206] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:35 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:56:36.303037 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:36.303804 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:36.310456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:36.310912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:36.311697 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:36.312127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:36.325856 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] HTTP exception thrown: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Request method failure captured: Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae HTTP/1.1 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq19pNk1RkIDiJiMKCzE9PCpBPuUQun4_1mSUwo3nfnAwMyegiewmRMyobilKEe4JZJ1CR2WZqpWLbVB1XyG4ulLv-KQQ7Nb906Ehhhd0xvBiVPPGyY_KdHdascahdWWVv_Rm8cQVHRCl-OjCoLFFs_EK32dgOIsbIuGLxzV4TxVpy0Y Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/992e429cb62643a1885c29538604ae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_992e429cb62643a1885c29538604ae5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d5d5414645ec47e1bcaa56860ba6daf6 Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '53a11b21-2cf2-45f9-9726-a3f7d7c191ae'} Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:56:36.327561 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Returning 404 to user: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-415a0ed5-5215-41f3-9852-35fedb2a32db tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 404 len: 111 microversion: 2.1 time: 0.030214 Jun 16 16:56:36.333079 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 842/1207] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:36 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:56:36.337544 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e3005ba5-91c1-455c-92c4-7fe7870f2967 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '.version_select at 0x7fe5fd249e50>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:36.356710 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e3005ba5-91c1-455c-92c4-7fe7870f2967 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803147277" status: 202 len: 0 microversion: 2.1 time: 0.022619 Jun 16 16:56:36.357280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 843/1208] 10.222.0.74 () {58 vars in 1217 bytes} [Thu Jun 16 16:56:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803147277 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:56:37.011788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e5fc144f-0d23-4937-b650-5f69f71130e2 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'create', calling method: .version_select at 0x7fe5fd2fe5e0>, body: {"keypair": {"name": "tempest-keypair-1259544452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0RVDoEiJ+Fv0LvgcCCIzsYsSHuzruZRgQ1/LVSlD26NM2IRBCebTH2/ko/Vp/6nG/eaJYr2uOnMRn8VS5OjzRDplK+JMDGE7tz9MZnnM2jUYIJ8+Qd9hUH3Dm1FaI30g=="}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:37.027464 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-e5fc144f-0d23-4937-b650-5f69f71130e2 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for project 992e429cb62643a1885c29538604ae5d. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:56:37.031617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-e5fc144f-0d23-4937-b650-5f69f71130e2 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for user d5d5414645ec47e1bcaa56860ba6daf6 and project 992e429cb62643a1885c29538604ae5d. Resources: {'key_pairs'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:56:37.058218 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e5fc144f-0d23-4937-b650-5f69f71130e2 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050460 Jun 16 16:56:37.059068 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 844/1209] 10.222.0.74 () {60 vars in 1158 bytes} [Thu Jun 16 16:56:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:38.399801 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1863565245", "imageRef": "5ffb5bc0-adef-4f9d-bb56-1692239fd92e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a239aaf5-accc-43f5-a202-3a023f480930"}], "security_groups": [{"name": "tempest-securitygroup--1158146313"}], "key_name": "tempest-keypair-1259544452", "user_data": "}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:38.506193 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.network.neutron [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] validate_networks() for [('a239aaf5-accc-43f5-a202-3a023f480930', None, None, None, None, None)] {{(pid=124104) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 16 16:56:38.876446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Flavor limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 16 16:56:38.876866 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Image limits 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 16 16:56:38.877335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Flavor pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 16 16:56:38.877748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Image pref 0:0:0 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 16 16:56:38.878145 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.virt.hardware [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124104) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 16 16:56:38.891739 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:38.892208 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:38.893209 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:38.893645 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:38.911422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for project 992e429cb62643a1885c29538604ae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 16 16:56:38.915411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.quota [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Getting quotas for user d5d5414645ec47e1bcaa56860ba6daf6 and project 992e429cb62643a1885c29538604ae5d. Resources: {'cores', 'instances', 'ram'} {{(pid=124104) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 16 16:56:38.927338 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Going to run 1 instances... {{(pid=124104) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 16 16:56:38.929625 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5ffb5bc0-adef-4f9d-bb56-1692239fd92e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124104) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 16 16:56:38.940780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:56:38.977342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-cb9c9162-91cc-451d-85d6-85bbb4f05c4b tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583014 Jun 16 16:56:38.977996 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 845/1210] 10.222.0.74 () {60 vars in 1146 bytes} [Thu Jun 16 16:56:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 16 16:56:38.988269 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dd01b628-9fc3-4aec-b6e5-47bc655e2815 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:38.988878 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dd01b628-9fc3-4aec-b6e5-47bc655e2815 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:39.046455 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dd01b628-9fc3-4aec-b6e5-47bc655e2815 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:39.056280 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dd01b628-9fc3-4aec-b6e5-47bc655e2815 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1238 microversion: 2.1 time: 0.072111 Jun 16 16:56:39.056855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 846/1211] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:38 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:40.073986 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:40.074719 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:40.081789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:40.082290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:40.083094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:40.083533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:40.158780 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:40.169228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c48840c9-013e-4be9-a141-44ef93550b15 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1298 microversion: 2.1 time: 0.099114 Jun 16 16:56:40.170031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 847/1212] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:40 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1298 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:41.187502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:41.188219 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:41.194893 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:41.195367 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:41.196153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:41.196576 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:41.344501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:41.355502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a95e0945-136a-4466-bc0a-d8af80220b98 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.171817 Jun 16 16:56:41.356365 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 848/1213] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:41 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:56:41.587802 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-1463a1af-33e2-415a-9b74-6a7ac78486f6 req-9d4de11c-3ca7-48d5-8bf2-e2d10ecd1118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09701ebb-5097-4226-885a-f98e92fd39b1", "tag": "a38ed0b4-3fd0-47bc-83fe-b2bae200768b"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:41.603371 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1463a1af-33e2-415a-9b74-6a7ac78486f6 req-9d4de11c-3ca7-48d5-8bf2-e2d10ecd1118 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:41.603737 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1463a1af-33e2-415a-9b74-6a7ac78486f6 req-9d4de11c-3ca7-48d5-8bf2-e2d10ecd1118 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:41.617144 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-1463a1af-33e2-415a-9b74-6a7ac78486f6 req-9d4de11c-3ca7-48d5-8bf2-e2d10ecd1118 service nova] Creating event network-changed:a38ed0b4-3fd0-47bc-83fe-b2bae200768b for instance 09701ebb-5097-4226-885a-f98e92fd39b1 on hv-cinder-83735 Jun 16 16:56:41.630681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-1463a1af-33e2-415a-9b74-6a7ac78486f6 req-9d4de11c-3ca7-48d5-8bf2-e2d10ecd1118 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048887 Jun 16 16:56:41.631726 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 849/1214] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:56:42.375585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:42.376284 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:42.387302 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:42.387759 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:42.388532 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:42.388967 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:42.530216 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:42.538340 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e64b65be-590c-40d9-a2b4-9938b081a6bf tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.167642 Jun 16 16:56:42.539087 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 850/1215] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:42 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:56:43.557169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:43.557169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:43.564392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:43.564835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:43.565603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:43.566032 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:43.711134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:43.720298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-0ddb3721-10d1-4ee4-abe7-3ab919d3ba0c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.167718 Jun 16 16:56:43.720298 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 851/1216] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:43 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:44.738083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:44.738914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:44.746355 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:44.746805 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:44.747687 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:44.748127 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:44.902048 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:44.917533 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1619a11f-48aa-402f-a591-780a10230761 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.183305 Jun 16 16:56:44.918155 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 852/1217] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:44 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:45.940257 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:45.941344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:45.948823 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:45.949304 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:45.950076 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:45.950514 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:46.096731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:46.104988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-97dea4c9-8e76-4fcb-83f3-2da1bf4f71d8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.171168 Jun 16 16:56:46.105828 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 853/1218] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:45 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:47.122290 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:47.122943 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:47.130088 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:47.130560 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:47.131494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:47.131920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:47.274782 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:47.282575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-bd54f8ce-9d18-479f-b084-bbd5530ce531 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.164331 Jun 16 16:56:47.283374 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 854/1219] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:47 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:48.453184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-1357845f-67cd-4536-b0fc-19f6e1354bde req-01cb319c-0cb0-431a-b3ab-5357dfe017d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09701ebb-5097-4226-885a-f98e92fd39b1", "name": "network-vif-plugged", "status": "completed", "tag": "a38ed0b4-3fd0-47bc-83fe-b2bae200768b"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:48.462174 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1357845f-67cd-4536-b0fc-19f6e1354bde req-01cb319c-0cb0-431a-b3ab-5357dfe017d6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:48.462605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-1357845f-67cd-4536-b0fc-19f6e1354bde req-01cb319c-0cb0-431a-b3ab-5357dfe017d6 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:48.475344 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-1357845f-67cd-4536-b0fc-19f6e1354bde req-01cb319c-0cb0-431a-b3ab-5357dfe017d6 service nova] Creating event network-vif-plugged:a38ed0b4-3fd0-47bc-83fe-b2bae200768b for instance 09701ebb-5097-4226-885a-f98e92fd39b1 on hv-cinder-83735 Jun 16 16:56:48.480446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-1357845f-67cd-4536-b0fc-19f6e1354bde req-01cb319c-0cb0-431a-b3ab-5357dfe017d6 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183426 Jun 16 16:56:48.481069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 855/1220] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:56:48.486119 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:48.486785 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:48.493404 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:48.493848 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:48.494607 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:48.495026 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:48.641406 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:48.650013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-fd23623e-f5c8-4616-b5eb-993d8932cc1a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.167795 Jun 16 16:56:48.650605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 856/1221] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:48 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:49.667701 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:49.668356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:49.670252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:56:49.671336 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell0:SELECT=12 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:56:49.678131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:49.678382 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:49.679192 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:49.679623 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:49.819585 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:49.829156 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8d50938f-6aa5-43f4-99f5-cb4af52df1e8 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1364 microversion: 2.1 time: 0.165456 Jun 16 16:56:49.829720 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 857/1222] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:49 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:50.848909 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:50.850149 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:50.857755 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:50.858217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:50.859314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:50.859748 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:51.004364 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:56:51.015675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ea2459fe-4dd9-4938-be41-c737daf6b112 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1549 microversion: 2.1 time: 0.171496 Jun 16 16:56:51.016400 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 858/1223] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:56:50 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:56:51.033148 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-8d0b654b-df78-4604-888e-a98bf07852b5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:56:51.033644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-8d0b654b-df78-4604-888e-a98bf07852b5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:56:51.040949 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-df78-4604-888e-a98bf07852b5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:51.041945 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-df78-4604-888e-a98bf07852b5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:51.042169 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-df78-4604-888e-a98bf07852b5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:51.042600 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-8d0b654b-df78-4604-888e-a98bf07852b5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:51.128611 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-8d0b654b-df78-4604-888e-a98bf07852b5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099112 Jun 16 16:56:51.129447 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 859/1224] 10.222.0.74 () {58 vars in 1274 bytes} [Thu Jun 16 16:56:51 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:56:52.306988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-d12931f2-cbcc-4e94-b967-a99e8014d6be req-f22c9d7a-2cee-45cf-a63e-1eb1a47c3f53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09701ebb-5097-4226-885a-f98e92fd39b1", "tag": "a38ed0b4-3fd0-47bc-83fe-b2bae200768b"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:56:52.315494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-d12931f2-cbcc-4e94-b967-a99e8014d6be req-f22c9d7a-2cee-45cf-a63e-1eb1a47c3f53 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:56:52.315931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-d12931f2-cbcc-4e94-b967-a99e8014d6be req-f22c9d7a-2cee-45cf-a63e-1eb1a47c3f53 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:56:52.327202 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-d12931f2-cbcc-4e94-b967-a99e8014d6be req-f22c9d7a-2cee-45cf-a63e-1eb1a47c3f53 service nova] Creating event network-changed:a38ed0b4-3fd0-47bc-83fe-b2bae200768b for instance 09701ebb-5097-4226-885a-f98e92fd39b1 on hv-cinder-83735 Jun 16 16:56:52.332261 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-d12931f2-cbcc-4e94-b967-a99e8014d6be req-f22c9d7a-2cee-45cf-a63e-1eb1a47c3f53 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029651 Jun 16 16:56:52.333151 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 860/1225] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:57:11.017976 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5368c3b4-08b0-44bd-87e0-5969991e982a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:57:11.019011 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5368c3b4-08b0-44bd-87e0-5969991e982a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:11.021529 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=32 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:57:11.022166 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=96 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:57:11.028672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5368c3b4-08b0-44bd-87e0-5969991e982a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:11.029116 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5368c3b4-08b0-44bd-87e0-5969991e982a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:11.029914 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5368c3b4-08b0-44bd-87e0-5969991e982a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:11.030345 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5368c3b4-08b0-44bd-87e0-5969991e982a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:11.110342 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5368c3b4-08b0-44bd-87e0-5969991e982a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/action" status: 202 len: 0 microversion: 2.1 time: 0.096660 Jun 16 16:57:11.112314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 861/1226] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:57:11 2022] POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:57:11.120320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:11.121009 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:11.128153 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:11.128778 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:11.129767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:11.130372 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:11.291067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:11.299495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-c31e000d-28e7-4ac7-8d24-6ca8299b01e8 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1752 microversion: 2.1 time: 0.183357 Jun 16 16:57:11.300090 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 862/1227] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:11 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:57:12.320605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:12.321333 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:12.328736 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:12.329215 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:12.329979 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:12.330402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:12.509537 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:12.519341 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d4cbd4cc-7694-45fd-94d8-2e3e37714e2b tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.204020 Jun 16 16:57:12.520654 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 863/1228] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:12 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:13.540347 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:13.541072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:13.548012 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:13.548448 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:13.549196 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:13.549621 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:13.708962 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:13.721489 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-532c1504-46cf-4217-9e71-b9cf41dc9d68 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.184787 Jun 16 16:57:13.722378 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 864/1229] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:13 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:57:14.739738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:14.740456 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:14.747474 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:14.747919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:14.748685 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:14.749117 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:14.908031 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:14.917677 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-9788df18-b65c-47fb-973e-060ae3996102 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.182485 Jun 16 16:57:14.918369 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 865/1230] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:14 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:15.938589 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:15.939396 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:15.947829 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:15.948276 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:15.949043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:15.949512 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:16.110965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:16.122903 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2299efa1-2de4-4f32-b853-eb04c17410e1 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.190427 Jun 16 16:57:16.123335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 866/1231] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:15 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:17.145358 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:17.146044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:17.152925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:17.153432 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:17.154285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:17.154718 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:17.324150 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:17.333128 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-13690c08-155b-4fbd-8555-884d16b45e61 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.193727 Jun 16 16:57:17.333750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 867/1232] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:17 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:18.350683 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:18.351430 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:18.358826 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:18.359477 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:18.360277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:18.360708 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:18.525307 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:18.533770 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e882c934-390c-43b6-8f68-638da7ef86d7 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.187626 Jun 16 16:57:18.534257 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 868/1233] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:18 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:19.556582 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:19.557191 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:19.564296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:19.564744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:19.565486 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:19.565951 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:19.721754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:19.730931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6cf60aed-2874-4a04-bf7a-34f5b5ed3b46 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.178307 Jun 16 16:57:19.731538 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 869/1234] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:19 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:20.761581 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:20.762274 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:20.769285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:20.769985 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:20.770476 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:20.770939 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:20.932494 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:20.945094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-f42f1f61-64fa-4bad-917a-5d9eb27b780f tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.198773 Jun 16 16:57:20.945956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 870/1235] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:20 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:21.965479 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:21.966438 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:21.974671 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:21.975107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:21.975886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:21.976309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:22.129296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:22.137981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a07ecde6-5821-4b63-b818-42227aab2e7c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1757 microversion: 2.1 time: 0.178027 Jun 16 16:57:22.138557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 871/1236] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:21 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:57:23.158676 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:57:23.159424 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:57:23.166744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:23.167227 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:23.168069 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:57:23.168540 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:57:23.327180 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:57:23.337018 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-eda5333d-050a-49eb-9f7f-1fbe41779c7a tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1760 microversion: 2.1 time: 0.182660 Jun 16 16:57:23.337603 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 872/1237] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:57:23 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1760 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:57:25.520463 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:57:25.521295 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:57:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:58:19.834509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4e579ad1-2522-4149-abb9-e7da15fc582a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:19.835225 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4e579ad1-2522-4149-abb9-e7da15fc582a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:19.837306 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=24 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:58:19.837963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:58:19.844681 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e579ad1-2522-4149-abb9-e7da15fc582a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:19.845114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e579ad1-2522-4149-abb9-e7da15fc582a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:19.845925 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e579ad1-2522-4149-abb9-e7da15fc582a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:19.846370 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e579ad1-2522-4149-abb9-e7da15fc582a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:19.872214 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4e579ad1-2522-4149-abb9-e7da15fc582a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/ips" status: 200 len: 144 microversion: 2.1 time: 0.042002 Jun 16 16:58:19.872817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 873/1238] 10.222.0.74 () {58 vars in 1247 bytes} [Thu Jun 16 16:58:19 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:21.217886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-93d6054c-1d55-45a0-aca2-3c97f1b22094 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8474afc1-8a76-4494-bf35-f5b6b1d0f3a9"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:58:21.219583 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-93d6054c-1d55-45a0-aca2-3c97f1b22094 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:21.227557 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d6054c-1d55-45a0-aca2-3c97f1b22094 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:21.228110 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d6054c-1d55-45a0-aca2-3c97f1b22094 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:21.229004 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d6054c-1d55-45a0-aca2-3c97f1b22094 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:21.229610 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-93d6054c-1d55-45a0-aca2-3c97f1b22094 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:21.507211 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-93d6054c-1d55-45a0-aca2-3c97f1b22094 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293344 Jun 16 16:58:21.508515 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 874/1239] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:58:21 2022] POST /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:58:27.153956 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1087014230"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:58:27.154655 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:27.161429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:27.161886 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:27.162644 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:27.163299 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:27.300050 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.network.security_group_api [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Removing security group 9d6749c7-ff30-4384-be32-50ed03eac9f2 from port a3912793-66cc-4f4c-9135-270beeb0c85a Jun 16 16:58:27.674184 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-4e2fff36-5039-449f-8a59-887d3ad6e112 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/action" status: 202 len: 0 microversion: 2.1 time: 0.525142 Jun 16 16:58:27.674806 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 875/1240] 10.222.0.74 () {60 vars in 1277 bytes} [Thu Jun 16 16:58:27 2022] POST /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/action => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:58:27.685651 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-4d85ce61-5a69-40ec-b047-ae76a935914d req-68dbfc6e-4ad3-429e-b8d5-5c0cc3a567ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8573b1cc-9337-4615-916b-af0b9326f737", "tag": "a3912793-66cc-4f4c-9135-270beeb0c85a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:58:27.698380 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-4d85ce61-5a69-40ec-b047-ae76a935914d req-68dbfc6e-4ad3-429e-b8d5-5c0cc3a567ce service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:27.698637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-4d85ce61-5a69-40ec-b047-ae76a935914d req-68dbfc6e-4ad3-429e-b8d5-5c0cc3a567ce service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:27.720185 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-4d85ce61-5a69-40ec-b047-ae76a935914d req-68dbfc6e-4ad3-429e-b8d5-5c0cc3a567ce service nova] Creating event network-changed:a3912793-66cc-4f4c-9135-270beeb0c85a for instance 8573b1cc-9337-4615-916b-af0b9326f737 on hv-cinder-83735 Jun 16 16:58:27.729393 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-4d85ce61-5a69-40ec-b047-ae76a935914d req-68dbfc6e-4ad3-429e-b8d5-5c0cc3a567ce service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047779 Jun 16 16:58:27.730463 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 876/1241] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:28.841601 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:28.842756 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:28.854047 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:28.854919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:28.856395 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:28.857233 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:28.947392 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lazy-loading 'services' on Instance uuid 8573b1cc-9337-4615-916b-af0b9326f737 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:58:29.028604 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3713e1ea-2e8f-4444-8750-e3e5cdaecc8e tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments/febe8a91-d7b9-4b2f-89c5-1e5a8a226961" status: 202 len: 0 microversion: 2.1 time: 0.196244 Jun 16 16:58:29.040317 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 877/1242] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:58:28 2022] DELETE /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments/febe8a91-d7b9-4b2f-89c5-1e5a8a226961 => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:58:29.052070 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b81264c9-b74a-47e1-a17e-f5c1dee6e9c0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:29.053186 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b81264c9-b74a-47e1-a17e-f5c1dee6e9c0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:29.062995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b81264c9-b74a-47e1-a17e-f5c1dee6e9c0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:29.063789 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b81264c9-b74a-47e1-a17e-f5c1dee6e9c0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:29.064755 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b81264c9-b74a-47e1-a17e-f5c1dee6e9c0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:29.065339 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b81264c9-b74a-47e1-a17e-f5c1dee6e9c0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:29.103291 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b81264c9-b74a-47e1-a17e-f5c1dee6e9c0 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058018 Jun 16 16:58:29.104252 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 878/1243] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:58:29 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:29.129883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-52f20fec-7a8b-409f-957f-820a6a64f7f6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:29.131082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-52f20fec-7a8b-409f-957f-820a6a64f7f6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:29.138569 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-52f20fec-7a8b-409f-957f-820a6a64f7f6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:29.139013 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-52f20fec-7a8b-409f-957f-820a6a64f7f6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:29.139810 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-52f20fec-7a8b-409f-957f-820a6a64f7f6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:29.140238 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-52f20fec-7a8b-409f-957f-820a6a64f7f6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:29.174972 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-52f20fec-7a8b-409f-957f-820a6a64f7f6 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049143 Jun 16 16:58:29.175593 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 879/1244] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:58:29 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:58:29.185501 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5bf23879-5246-469c-84be-3830051874e1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:29.186085 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5bf23879-5246-469c-84be-3830051874e1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:29.192321 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5bf23879-5246-469c-84be-3830051874e1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:29.192707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5bf23879-5246-469c-84be-3830051874e1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:29.193471 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5bf23879-5246-469c-84be-3830051874e1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:29.193900 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5bf23879-5246-469c-84be-3830051874e1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:29.224509 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5bf23879-5246-469c-84be-3830051874e1 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/8474afc1-8a76-4494-bf35-f5b6b1d0f3a9" status: 200 len: 194 microversion: 2.1 time: 0.042858 Jun 16 16:58:29.225121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 880/1245] 10.222.0.74 () {58 vars in 1412 bytes} [Thu Jun 16 16:58:29 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/8474afc1-8a76-4494-bf35-f5b6b1d0f3a9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:58:29.804391 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-c585861a-cdfa-4cea-8fd4-74cf0c722ed7 req-17dddaa8-5093-438a-afb6-2c24d89e8922 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8573b1cc-9337-4615-916b-af0b9326f737", "tag": "a3912793-66cc-4f4c-9135-270beeb0c85a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:58:29.812884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-c585861a-cdfa-4cea-8fd4-74cf0c722ed7 req-17dddaa8-5093-438a-afb6-2c24d89e8922 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:29.813320 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-c585861a-cdfa-4cea-8fd4-74cf0c722ed7 req-17dddaa8-5093-438a-afb6-2c24d89e8922 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:29.825617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-c585861a-cdfa-4cea-8fd4-74cf0c722ed7 req-17dddaa8-5093-438a-afb6-2c24d89e8922 service nova] Creating event network-changed:a3912793-66cc-4f4c-9135-270beeb0c85a for instance 8573b1cc-9337-4615-916b-af0b9326f737 on hv-cinder-83735 Jun 16 16:58:29.830679 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-c585861a-cdfa-4cea-8fd4-74cf0c722ed7 req-17dddaa8-5093-438a-afb6-2c24d89e8922 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087651 Jun 16 16:58:29.831314 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 881/1246] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:30.117488 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-b6dc8abc-5c8f-45bd-9b95-f9a87b0bdcb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:30.119446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-b6dc8abc-5c8f-45bd-9b95-f9a87b0bdcb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:30.126637 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6dc8abc-5c8f-45bd-9b95-f9a87b0bdcb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:30.127154 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6dc8abc-5c8f-45bd-9b95-f9a87b0bdcb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:30.127926 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6dc8abc-5c8f-45bd-9b95-f9a87b0bdcb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:30.128357 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-b6dc8abc-5c8f-45bd-9b95-f9a87b0bdcb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:30.159097 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-b6dc8abc-5c8f-45bd-9b95-f9a87b0bdcb9 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047569 Jun 16 16:58:30.159981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 882/1247] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:58:30 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:30.563084 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-283593aa-a67f-4e3e-a56b-065bffdd5da5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "179059e8-7d0f-42ac-a134-eb77141e0aa1"}} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:58:30.565195 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-283593aa-a67f-4e3e-a56b-065bffdd5da5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:30.571721 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-283593aa-a67f-4e3e-a56b-065bffdd5da5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:30.572114 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-283593aa-a67f-4e3e-a56b-065bffdd5da5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:30.572954 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-283593aa-a67f-4e3e-a56b-065bffdd5da5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:30.573386 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-283593aa-a67f-4e3e-a56b-065bffdd5da5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:30.850835 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-283593aa-a67f-4e3e-a56b-065bffdd5da5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "POST /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291721 Jun 16 16:58:30.851498 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 883/1248] 10.222.0.74 () {60 vars in 1322 bytes} [Thu Jun 16 16:58:30 2022] POST /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:31.172931 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dfb45e92-3811-4cc8-a2bd-325498f2a9fa tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:31.173965 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dfb45e92-3811-4cc8-a2bd-325498f2a9fa tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:31.181302 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb45e92-3811-4cc8-a2bd-325498f2a9fa tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:31.181750 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb45e92-3811-4cc8-a2bd-325498f2a9fa tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:31.182522 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb45e92-3811-4cc8-a2bd-325498f2a9fa tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:31.182984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dfb45e92-3811-4cc8-a2bd-325498f2a9fa tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:31.214589 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dfb45e92-3811-4cc8-a2bd-325498f2a9fa tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046474 Jun 16 16:58:31.215228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 884/1249] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:58:31 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 16 16:58:31.225760 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:31.226055 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:31.232817 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:31.233226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:31.234043 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:31.234478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:31.326411 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] HTTP exception thrown: Instance 8573b1cc-9337-4615-916b-af0b9326f737 is not attached to volume febe8a91-d7b9-4b2f-89c5-1e5a8a226961 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Request method failure captured: Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments/febe8a91-d7b9-4b2f-89c5-1e5a8a226961 HTTP/1.1 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2Bn_YJWIGrnAU3sRsrKZE0N4aFznHbRJDwXoQJSf7WbFt8I5yYYgyCHklE1I4sSlz7bzKre9v1-UO1oZ6-1nmoJcW2PPG0UwW0_fVVG-CUyRqVSThlqZGGEJS_YrnY2o6bKYhrVry5GXf6f75wDQySpkrCjLuYaNXcmYYROLmUoRKc Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0a55a4c28c4140958e1c078eaf57f9fd Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestMinimumBasicScenario-455328063 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestMinimumBasicScenario-455328063 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0a55a4c28c4140958e1c078eaf57f9fd Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestMinimumBasicScenario-455328063 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestMinimumBasicScenario-455328063-project Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 690436e83b26412cb5c84f47202834f4 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestMinimumBasicScenario-455328063-project Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 8573b1cc-9337-4615-916b-af0b9326f737 is not attached to volume febe8a91-d7b9-4b2f-89c5-1e5a8a226961 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'server_id': '8573b1cc-9337-4615-916b-af0b9326f737', 'id': 'febe8a91-d7b9-4b2f-89c5-1e5a8a226961'} Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id febe8a91-d7b9-4b2f-89c5-1e5a8a226961. Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8573b1cc-9337-4615-916b-af0b9326f737 is not attached to volume febe8a91-d7b9-4b2f-89c5-1e5a8a226961 Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:31.328884 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:31.334190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:58:31.334190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:58:31.334190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8573b1cc-9337-4615-916b-af0b9326f737 is not attached to volume febe8a91-d7b9-4b2f-89c5-1e5a8a226961 Jun 16 16:58:31.334190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:31.334190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Returning 404 to user: Instance 8573b1cc-9337-4615-916b-af0b9326f737 is not attached to volume febe8a91-d7b9-4b2f-89c5-1e5a8a226961 {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:58:31.334190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-3ae75a6f-a94b-4645-93bb-a73232a44581 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments/febe8a91-d7b9-4b2f-89c5-1e5a8a226961" status: 404 len: 154 microversion: 2.1 time: 0.108881 Jun 16 16:58:31.334190 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 885/1250] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:58:31 2022] DELETE /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737/os-volume_attachments/febe8a91-d7b9-4b2f-89c5-1e5a8a226961 => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:58:32.471023 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:32.471773 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:32.481920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:32.482366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:32.483175 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:32.483605 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:32.510915 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:58:32.558255 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:58:32.600587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-6cb1bc41-43ae-459c-a48f-990c3e1429fc tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "DELETE /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 204 len: 0 microversion: 2.1 time: 0.133180 Jun 16 16:58:32.601228 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 886/1251] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:58:32 2022] DELETE /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 16 16:58:32.609773 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:32.610478 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:32.617072 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:32.617521 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:32.618285 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:32.618713 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:32.759076 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:58:32.767134 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e6be7d6b-8ff2-4989-80eb-1050e5943a87 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1554 microversion: 2.1 time: 0.161379 Jun 16 16:58:32.767772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 887/1252] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:32 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:58:33.784920 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:33.785631 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:33.792356 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:33.792824 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:33.793575 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:33.793999 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:33.924246 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:58:33.932350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc366107-2111-4c1e-8390-69b6a6a7032c tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1554 microversion: 2.1 time: 0.151392 Jun 16 16:58:33.932932 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 888/1253] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:33 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:58:34.953115 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:34.954008 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:34.962250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:34.962788 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:34.963754 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:34.964293 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:35.060497 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '690436e83b26412cb5c84f47202834f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a55a4c28c4140958e1c078eaf57f9fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:58:35.070934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-868066ac-135d-47c8-8106-5b1dc79646c5 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 200 len: 1512 microversion: 2.1 time: 0.121994 Jun 16 16:58:35.072381 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 889/1254] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:34 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 1512 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:58:35.162237 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-5311565c-ec98-46f7-ab7f-9c43124a2189 req-ee65d60f-6f34-4609-b382-459459d30091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8573b1cc-9337-4615-916b-af0b9326f737", "name": "network-vif-deleted", "tag": "a3912793-66cc-4f4c-9135-270beeb0c85a"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:58:35.172311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5311565c-ec98-46f7-ab7f-9c43124a2189 req-ee65d60f-6f34-4609-b382-459459d30091 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:35.172752 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-5311565c-ec98-46f7-ab7f-9c43124a2189 req-ee65d60f-6f34-4609-b382-459459d30091 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:35.186553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-5311565c-ec98-46f7-ab7f-9c43124a2189 req-ee65d60f-6f34-4609-b382-459459d30091 service nova] Creating event network-vif-deleted:a3912793-66cc-4f4c-9135-270beeb0c85a for instance 8573b1cc-9337-4615-916b-af0b9326f737 on hv-cinder-83735 Jun 16 16:58:35.193083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-5311565c-ec98-46f7-ab7f-9c43124a2189 req-ee65d60f-6f34-4609-b382-459459d30091 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102771 Jun 16 16:58:35.193758 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 890/1255] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 16 16:58:36.091105 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:36.091870 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] [instance: 8573b1cc-9337-4615-916b-af0b9326f737] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:36.098744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:36.099226 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:36.099995 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:36.100963 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:36.115083 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] HTTP exception thrown: Instance 8573b1cc-9337-4615-916b-af0b9326f737 could not be found. Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Request method failure captured: Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 HTTP/1.1 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq2Bn_YJWIGrnAU3sRsrKZE0N4aFznHbRJDwXoQJSf7WbFt8I5yYYgyCHklE1I4sSlz7bzKre9v1-UO1oZ6-1nmoJcW2PPG0UwW0_fVVG-CUyRqVSThlqZGGEJS_YrnY2o6bKYhrVry5GXf6f75wDQySpkrCjLuYaNXcmYYROLmUoRKc Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 0a55a4c28c4140958e1c078eaf57f9fd Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-TestMinimumBasicScenario-455328063 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_0a55a4c28c4140958e1c078eaf57f9fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-TestMinimumBasicScenario-455328063 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 0a55a4c28c4140958e1c078eaf57f9fd Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-TestMinimumBasicScenario-455328063 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-TestMinimumBasicScenario-455328063-project Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: 690436e83b26412cb5c84f47202834f4 Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-TestMinimumBasicScenario-455328063-project Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 8573b1cc-9337-4615-916b-af0b9326f737 could not be found. Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '8573b1cc-9337-4615-916b-af0b9326f737'} Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8573b1cc-9337-4615-916b-af0b9326f737 could not be found. Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8573b1cc-9337-4615-916b-af0b9326f737 could not be found. Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:36.117107 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8573b1cc-9337-4615-916b-af0b9326f737 could not be found. Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Returning 404 to user: Instance 8573b1cc-9337-4615-916b-af0b9326f737 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a87ddd03-9780-4880-aa33-cb4838b3d639 tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737" status: 404 len: 111 microversion: 2.1 time: 0.032220 Jun 16 16:58:36.122346 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 891/1256] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:36 2022] GET /compute/v2.1/servers/8573b1cc-9337-4615-916b-af0b9326f737 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:58:36.127223 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-e61dc6ba-e571-47a3-9038-d9ed53b9fabd tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] Calling method '.version_select at 0x7fe5f8c1b160>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:36.154373 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-e61dc6ba-e571-47a3-9038-d9ed53b9fabd tempest-TestMinimumBasicScenario-455328063 tempest-TestMinimumBasicScenario-455328063-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1625831900" status: 202 len: 0 microversion: 2.1 time: 0.029239 Jun 16 16:58:36.157630 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 892/1257] 10.222.0.74 () {58 vars in 1271 bytes} [Thu Jun 16 16:58:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1625831900 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:58:38.417594 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ccf89ad8-29b4-48cf-8193-92b5405bdcbb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:38.419286 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-ccf89ad8-29b4-48cf-8193-92b5405bdcbb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:38.426988 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccf89ad8-29b4-48cf-8193-92b5405bdcbb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:38.427446 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccf89ad8-29b4-48cf-8193-92b5405bdcbb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:38.428352 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccf89ad8-29b4-48cf-8193-92b5405bdcbb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:38.428872 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-ccf89ad8-29b4-48cf-8193-92b5405bdcbb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:38.473547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ccf89ad8-29b4-48cf-8193-92b5405bdcbb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.060873 Jun 16 16:58:38.474495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 893/1258] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:58:38 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments => generated 371 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:38.617725 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-7aa05345-30dc-4b3d-9f9f-11658a27fafc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:38.618596 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-7aa05345-30dc-4b3d-9f9f-11658a27fafc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:38.624768 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7aa05345-30dc-4b3d-9f9f-11658a27fafc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:38.625324 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7aa05345-30dc-4b3d-9f9f-11658a27fafc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:38.626094 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7aa05345-30dc-4b3d-9f9f-11658a27fafc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:38.626521 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-7aa05345-30dc-4b3d-9f9f-11658a27fafc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:38.657666 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-7aa05345-30dc-4b3d-9f9f-11658a27fafc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/8474afc1-8a76-4494-bf35-f5b6b1d0f3a9" status: 200 len: 194 microversion: 2.1 time: 0.044283 Jun 16 16:58:38.658277 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 894/1259] 10.222.0.74 () {58 vars in 1412 bytes} [Thu Jun 16 16:58:38 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/8474afc1-8a76-4494-bf35-f5b6b1d0f3a9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:38.668566 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:38.669366 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:38.676420 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:38.676855 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:38.677809 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:38.678502 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:38.776269 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lazy-loading 'services' on Instance uuid 09701ebb-5097-4226-885a-f98e92fd39b1 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:58:38.861730 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-66b2fd12-4247-4586-bc5a-668a088cf8fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/8474afc1-8a76-4494-bf35-f5b6b1d0f3a9" status: 202 len: 0 microversion: 2.1 time: 0.196888 Jun 16 16:58:38.862690 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 895/1260] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:58:38 2022] DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/8474afc1-8a76-4494-bf35-f5b6b1d0f3a9 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:58:40.055997 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc845bab-735b-4f39-b69b-29f1a503a987 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:40.060112 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc845bab-735b-4f39-b69b-29f1a503a987 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:40.077132 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc845bab-735b-4f39-b69b-29f1a503a987 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:40.078495 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc845bab-735b-4f39-b69b-29f1a503a987 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:40.088660 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc845bab-735b-4f39-b69b-29f1a503a987 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:40.089229 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc845bab-735b-4f39-b69b-29f1a503a987 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:40.156296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc845bab-735b-4f39-b69b-29f1a503a987 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/179059e8-7d0f-42ac-a134-eb77141e0aa1" status: 200 len: 194 microversion: 2.1 time: 0.107349 Jun 16 16:58:40.156923 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 896/1261] 10.222.0.74 () {58 vars in 1412 bytes} [Thu Jun 16 16:58:40 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/179059e8-7d0f-42ac-a134-eb77141e0aa1 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:40.168907 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:40.169649 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:40.178270 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:40.178952 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:40.179978 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:40.180609 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:40.340675 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.objects.instance [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lazy-loading 'services' on Instance uuid 09701ebb-5097-4226-885a-f98e92fd39b1 {{(pid=124104) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 16 16:58:40.451483 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-df041097-c1d2-48ed-a4fc-27ea9bd8d8fb tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/179059e8-7d0f-42ac-a134-eb77141e0aa1" status: 202 len: 0 microversion: 2.1 time: 0.286751 Jun 16 16:58:40.452553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 897/1262] 10.222.0.74 () {58 vars in 1415 bytes} [Thu Jun 16 16:58:40 2022] DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments/179059e8-7d0f-42ac-a134-eb77141e0aa1 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 16 16:58:41.635839 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dbd8d422-0205-4f57-8377-17d40ab47fad tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:41.636889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dbd8d422-0205-4f57-8377-17d40ab47fad tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:41.643600 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dbd8d422-0205-4f57-8377-17d40ab47fad tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:41.644044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dbd8d422-0205-4f57-8377-17d40ab47fad tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:41.644813 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dbd8d422-0205-4f57-8377-17d40ab47fad tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:41.645240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dbd8d422-0205-4f57-8377-17d40ab47fad tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:41.676698 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dbd8d422-0205-4f57-8377-17d40ab47fad tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046835 Jun 16 16:58:41.677472 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 898/1263] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:58:41 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:58:41.808638 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-1fdd7cae-dbcc-41ff-a364-082b9e8332f5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:41.809572 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-1fdd7cae-dbcc-41ff-a364-082b9e8332f5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:41.816191 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cae-dbcc-41ff-a364-082b9e8332f5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:41.816636 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cae-dbcc-41ff-a364-082b9e8332f5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:41.817401 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cae-dbcc-41ff-a364-082b9e8332f5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:41.817831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-1fdd7cae-dbcc-41ff-a364-082b9e8332f5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:41.851669 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-1fdd7cae-dbcc-41ff-a364-082b9e8332f5 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046962 Jun 16 16:58:41.853067 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 899/1264] 10.222.0.74 () {58 vars in 1301 bytes} [Thu Jun 16 16:58:41 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 16 16:58:41.916178 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:41.916981 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:41.923672 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:41.924373 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:41.925318 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:41.925913 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:41.952077 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Going to try to terminate instance {{(pid=124104) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 16 16:58:42.050617 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d8bdaee1-9aec-4b8e-9e91-f9cb2b3a6d0f tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 204 len: 0 microversion: 2.1 time: 0.138004 Jun 16 16:58:42.051250 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 900/1265] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:58:41 2022] DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 16 16:58:42.060256 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:42.060953 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:42.067819 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:42.068260 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:42.069082 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:42.069808 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:42.229553 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:58:42.237944 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-66c4ddd4-fa3d-4359-b62d-46cfe2989403 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1673 microversion: 2.1 time: 0.181968 Jun 16 16:58:42.238889 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 901/1266] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:42 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1673 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 16 16:58:43.255793 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:43.256831 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:43.264104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:43.264535 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:43.265309 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:43.265740 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:43.285744 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=4,nova_cell1:UPDATE=1 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:58:43.424179 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:58:43.433422 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-00bf7853-7986-4d5d-b597-2d67d67fc42a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1673 microversion: 2.1 time: 0.181543 Jun 16 16:58:43.434104 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 902/1267] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:43 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:58:44.450777 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:44.451462 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:44.458429 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:44.458845 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:44.459994 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:44.460402 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:44.617240 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.policy [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd5d5414645ec47e1bcaa56860ba6daf6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '992e429cb62643a1885c29538604ae5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124104) authorize /opt/stack/nova/nova/policy.py:199}} Jun 16 16:58:44.624934 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-2ca5c2f8-1935-446a-a388-48f6f5d95e25 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 200 len: 1673 microversion: 2.1 time: 0.177932 Jun 16 16:58:44.625628 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 903/1268] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:44 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 16 16:58:45.025469 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [req-046fd0e4-0e2e-4c67-bcb5-bcacb924b14d req-74d69e9f-e5d6-4c04-8815-1763954cab02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09701ebb-5097-4226-885a-f98e92fd39b1", "name": "network-vif-deleted", "tag": "a38ed0b4-3fd0-47bc-83fe-b2bae200768b"}]} {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 16 16:58:45.039883 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-046fd0e4-0e2e-4c67-bcb5-bcacb924b14d req-74d69e9f-e5d6-4c04-8815-1763954cab02 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:45.040332 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [req-046fd0e4-0e2e-4c67-bcb5-bcacb924b14d req-74d69e9f-e5d6-4c04-8815-1763954cab02 service nova] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:45.058301 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.compute.server_external_events [req-046fd0e4-0e2e-4c67-bcb5-bcacb924b14d req-74d69e9f-e5d6-4c04-8815-1763954cab02 service nova] Creating event network-vif-deleted:a38ed0b4-3fd0-47bc-83fe-b2bae200768b for instance 09701ebb-5097-4226-885a-f98e92fd39b1 on hv-cinder-83735 Jun 16 16:58:45.069853 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [req-046fd0e4-0e2e-4c67-bcb5-bcacb924b14d req-74d69e9f-e5d6-4c04-8815-1763954cab02 service nova] 10.222.0.74 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050440 Jun 16 16:58:45.072034 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 904/1269] 10.222.0.74 () {64 vars in 1317 bytes} [Thu Jun 16 16:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 16 16:58:45.643732 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:45.644614 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:45.657772 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:45.659874 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:45.660970 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:45.661624 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:45.682568 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] HTTP exception thrown: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Request method failure captured: Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 HTTP/1.1 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq19pNk1RkIDiJiMKCzE9PCpBPuUQun4_1mSUwo3nfnAwMyegiewmRMyobilKEe4JZJ1CR2WZqpWLbVB1XyG4ulLv-KQQ7Nb906Ehhhd0xvBiVPPGyY_KdHdascahdWWVv_Rm8cQVHRCl-OjCoLFFs_EK32dgOIsbIuGLxzV4TxVpy0Y Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/992e429cb62643a1885c29538604ae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_992e429cb62643a1885c29538604ae5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d5d5414645ec47e1bcaa56860ba6daf6 Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '09701ebb-5097-4226-885a-f98e92fd39b1'} Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:45.684738 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Returning 404 to user: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d0f31f93-2662-4f27-a6e9-68a7e168434a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 404 len: 111 microversion: 2.1 time: 0.047301 Jun 16 16:58:45.689640 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 905/1270] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:45 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:58:45.696803 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-ef6b0171-aaf4-4ce2-bba9-f7cf528d56be tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '.version_select at 0x7fe5fd254670>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:45.720587 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-ef6b0171-aaf4-4ce2-bba9-f7cf528d56be tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259544452" status: 202 len: 0 microversion: 2.1 time: 0.027968 Jun 16 16:58:45.722044 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 906/1271] 10.222.0.74 () {58 vars in 1220 bytes} [Thu Jun 16 16:58:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1259544452 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 16 16:58:48.655075 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:48.655707 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:48.661731 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:48.662217 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:48.662979 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:48.663475 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:48.677490 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] HTTP exception thrown: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Request method failure captured: Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 HTTP/1.1 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq19pNk1RkIDiJiMKCzE9PCpBPuUQun4_1mSUwo3nfnAwMyegiewmRMyobilKEe4JZJ1CR2WZqpWLbVB1XyG4ulLv-KQQ7Nb906Ehhhd0xvBiVPPGyY_KdHdascahdWWVv_Rm8cQVHRCl-OjCoLFFs_EK32dgOIsbIuGLxzV4TxVpy0Y Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/992e429cb62643a1885c29538604ae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_992e429cb62643a1885c29538604ae5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d5d5414645ec47e1bcaa56860ba6daf6 Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '09701ebb-5097-4226-885a-f98e92fd39b1'} Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:58:48.679350 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Returning 404 to user: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-5aba8483-4f63-4cfd-8054-b86b71af008c tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 404 len: 111 microversion: 2.1 time: 0.030300 Jun 16 16:58:48.684444 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 907/1272] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:58:48 2022] DELETE /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:58:48.690247 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:48.690932 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 09701ebb-5097-4226-885a-f98e92fd39b1] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:48.698825 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:48.699296 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:48.700084 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:48.700507 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:48.716496 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] HTTP exception thrown: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Request method failure captured: Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 HTTP/1.1 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq19pNk1RkIDiJiMKCzE9PCpBPuUQun4_1mSUwo3nfnAwMyegiewmRMyobilKEe4JZJ1CR2WZqpWLbVB1XyG4ulLv-KQQ7Nb906Ehhhd0xvBiVPPGyY_KdHdascahdWWVv_Rm8cQVHRCl-OjCoLFFs_EK32dgOIsbIuGLxzV4TxVpy0Y Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/992e429cb62643a1885c29538604ae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_992e429cb62643a1885c29538604ae5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d5d5414645ec47e1bcaa56860ba6daf6 Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '09701ebb-5097-4226-885a-f98e92fd39b1'} Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:48.719188 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Returning 404 to user: Instance 09701ebb-5097-4226-885a-f98e92fd39b1 could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-a49f4a6b-6723-4be3-9d20-f250d671e2fc tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1" status: 404 len: 111 microversion: 2.1 time: 0.034500 Jun 16 16:58:48.728020 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 908/1273] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:48 2022] GET /compute/v2.1/servers/09701ebb-5097-4226-885a-f98e92fd39b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 16 16:58:49.878659 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:49.879311 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:49.881984 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG dbcounter [-] [124104] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=124104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 16:58:49.887919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:49.888360 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:49.889131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:49.889558 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:49.905526 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] HTTP exception thrown: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Request method failure captured: Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: DELETE /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae HTTP/1.1 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq19pNk1RkIDiJiMKCzE9PCpBPuUQun4_1mSUwo3nfnAwMyegiewmRMyobilKEe4JZJ1CR2WZqpWLbVB1XyG4ulLv-KQQ7Nb906Ehhhd0xvBiVPPGyY_KdHdascahdWWVv_Rm8cQVHRCl-OjCoLFFs_EK32dgOIsbIuGLxzV4TxVpy0Y Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/992e429cb62643a1885c29538604ae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_992e429cb62643a1885c29538604ae5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d5d5414645ec47e1bcaa56860ba6daf6 Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '53a11b21-2cf2-45f9-9726-a3f7d7c191ae'} Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:58:49.907121 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Returning 404 to user: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-d9c16197-a835-4468-89fa-b96c2a856f60 tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "DELETE /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 404 len: 111 microversion: 2.1 time: 0.034052 Jun 16 16:58:49.912131 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 909/1274] 10.222.0.74 () {58 vars in 1238 bytes} [Thu Jun 16 16:58:49 2022] DELETE /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:58:49.916846 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Calling method '>' {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 16 16:58:49.917454 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.compute.api [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] [instance: 53a11b21-2cf2-45f9-9726-a3f7d7c191ae] Fetching instance by UUID {{(pid=124104) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 16 16:58:49.923547 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:49.923990 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:49.924745 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 16 16:58:49.925178 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG oslo_concurrency.lockutils [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Lock "a2503fb0-10e9-49f5-9aa8-746908a7d718" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124104) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 16 16:58:49.939852 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.wsgi [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] HTTP exception thrown: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Request method failure captured: Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: request: GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae HTTP/1.1 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept: application/json Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Accept-Encoding: identity Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Connection: close Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Length: 0 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Content-Type: application/json Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Host: 10.222.0.74 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Openstack-System-Scope: None Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: User-Agent: python-urllib3/1.26.9 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Auth-Token: gAAAAABiq19pNk1RkIDiJiMKCzE9PCpBPuUQun4_1mSUwo3nfnAwMyegiewmRMyobilKEe4JZJ1CR2WZqpWLbVB1XyG4ulLv-KQQ7Nb906Ehhhd0xvBiVPPGyY_KdHdascahdWWVv_Rm8cQVHRCl-OjCoLFFs_EK32dgOIsbIuGLxzV4TxVpy0Y Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Id: None Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Domain-Name: None Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Identity-Status: Confirmed Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Is-Admin-Project: True Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Id: default Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Domain-Name: Default Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Project-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Role: reader,member Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Roles: reader,member Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2/992e429cb62643a1885c29538604ae5d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/volume/v3/992e429cb62643a1885c29538604ae5d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.74:8080", "publicURL": "http://10.222.0.74:8080/v1/AUTH_992e429cb62643a1885c29538604ae5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.74/image"}]}] Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Id: 992e429cb62643a1885c29538604ae5d Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1448967232 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Id: default Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Domain-Name: Default Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Id: d5d5414645ec47e1bcaa56860ba6daf6 Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: X-User-Name: tempest-AttachVolumeTestJSON-1448967232-project Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: method: > Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: exception: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: action_args: {'id': '53a11b21-2cf2-45f9-9726-a3f7d7c191ae'} Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: {{(pid=124104) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 16 16:58:49.941574 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: ERROR nova.api.openstack.wsgi Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: DEBUG nova.api.openstack.wsgi [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] Returning 404 to user: Instance 53a11b21-2cf2-45f9-9726-a3f7d7c191ae could not be found. {{(pid=124104) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO nova.api.openstack.requestlog [None req-dc61e688-a2e3-4f4c-adec-86ca34b58c3a tempest-AttachVolumeTestJSON-1448967232 tempest-AttachVolumeTestJSON-1448967232-project] 10.222.0.74 "GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae" status: 404 len: 111 microversion: 2.1 time: 0.029826 Jun 16 16:58:49.949066 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: [pid: 124104|app: 0|req: 910/1275] 10.222.0.74 () {58 vars in 1235 bytes} [Thu Jun 16 16:58:49 2022] GET /compute/v2.1/servers/53a11b21-2cf2-45f9-9726-a3f7d7c191ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 16 16:59:07.510919 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:59:07.511784 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Thu Jun 16 16:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 16:59:09.804603 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:59:09.805223 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:59:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 16:59:47.875831 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 16:59:47.877105 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 16:59:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 17:00:45.531655 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:00:45.532409 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 17:00:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 17:01:12.533253 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:01:12.533912 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Thu Jun 16 17:01:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:02:27.521767 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:02:27.522564 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Thu Jun 16 17:02:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:02:29.814437 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:02:29.815230 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 17:02:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 17:03:07.885444 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:03:07.892630 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 17:03:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 17:04:01.938042 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:04:01.938562 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Thu Jun 16 17:04:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 16 17:04:05.541494 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:04:05.542113 dv-cinder-837355-2-iscsi devstack@n-api.service[124103]: Thu Jun 16 17:04:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.74) !!! Jun 16 17:04:32.544674 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 16 17:04:32.545335 dv-cinder-837355-2-iscsi devstack@n-api.service[124104]: Thu Jun 16 17:04:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!